Search

We are now in the era of millimeter-scale electron microscopy (EM) volumes collected at nanometer resolution (Shapson-Coe et al., 2021; Consortium et al., 2021). Dense reconstruction of cellular compartments in these EM volumes has been enabled by recent advances in Machine Learning (ML) (Lee et al., 2017; Wu et al., 2021; Lu et al., 2021; Macrina et al., 2021). Automated segmentation methods can now yield exceptionally accurate reconstructions of cells, but despite this accuracy, laborious post-hoc proofreading is still required to generate large connectomes free of merge and split errors. The elaborate 3-D meshes of neurons produced by these segmentations contain detailed morphological information, from the diameter, shape, and branching patterns of axons and dendrites, down to the fine-scale structure of dendritic spines. However, extracting information about these features can require substantial effort to piece together existing tools into custom workflows. Building on existing open-source software for mesh manipulation, here we present “NEURD”, a software package that decomposes each meshed neuron into a compact and extensively-annotated graph representation. With these feature-rich graphs, we implement workflows for state of the art automated post-hoc proofreading of merge errors, cell classification, spine detection, axon-dendritic proximities, and other features that can enable many downstream analyses of neural morphology and connectivity. NEURD can make these new massive and complex datasets more accessible to neuroscience researchers focused on a variety of scientific questions.

To understand how the neocortex underlies our ability to perceive, think, and act, it is important to study the relationship between circuit connectivity and function. Previous research has shown that excitatory neurons in layer 2/3 of the primary visual cortex of mice with similar response properties are more likely to form connections. However, technical challenges of combining synaptic connectivity and functional measurements have limited these studies to few, highly local connections. Utilizing the millimeter scale and nanometer resolution of the MICrONS dataset, we studied the connectivity-function relationship in excitatory neurons of the mouse visual cortex across interlaminar and interarea projections, assessing connection selectivity at the coarse axon trajectory and fine synaptic formation levels. A digital twin model of this mouse, that accurately predicted responses to arbitrary video stimuli, enabled a comprehensive characterization of the function of neurons. We found that neurons with highly correlated responses to natural videos tended to be connected with each other, not only within the same cortical area but also across multiple layers and visual areas, including feedforward and feedback connections, whereas we did not find that orientation preference predicted connectivity. The digital twin model separated each neuron’s tuning into a feature component (what the neuron responds to) and a spatial component (where the neuron’s receptive field is located). We show that the feature, but not the spatial component, predicted which neurons were connected at the fine synaptic scale. Together, our results demonstrate the “like-to-like” connectivity rule generalizes to multiple connection types, and the rich MICrONS dataset is suitable to further refine a mechanistic understanding of circuit structure and function.

Neurons in the neocortex exhibit astonishing morphological diversity which is critical for properly wiring neural circuits and giving neurons their functional properties. The extent to which the morphological diversity of excitatory neurons forms a continuum or is built from distinct clusters of cell types remains an open question. Here we took a data-driven approach using graph-based machine learning methods to obtain a low-dimensional morphological “bar code” describing more than 30,000 excitatory neurons in mouse visual areas V1, AL and RL that were reconstructed from a millimeter scale serial-section electron microscopy volume. We found a set of principles that captured the morphological diversity of the dendrites of excitatory neurons. First, their morphologies varied with respect to three major axes: soma depth, total apical and basal skeletal length. Second, neurons in layer 2/3 showed a strong trend of a decreasing width of their dendritic arbor and a smaller tuft with increasing cortical depth. Third, in layer 4, atufted neurons were primarily located in the primary visual cortex, while tufted neurons were more abundant in higher visual areas. Fourth, we discovered layer 4 neurons in V1 on the border to layer 5 which showed a tendency towards avoiding deeper layers with their dendrites. In summary, excitatory neurons exhibited a substantial degree of dendritic morphological variation, both within and across cortical layers, but this variation mostly formed a continuum, with only a few notable exceptions in deeper layers.

Neurons in the developing brain undergo extensive structural refinement as nascent circuits adopt their mature form. This physical transformation of neurons is facilitated by the engulfment and degradation of axonal branches and synapses by surrounding glial cells, including microglia and astrocytes. However, the small size of phagocytic organelles and the complex, highly ramified morphology of glia have made it difficult to define the contribution of these and other glial cell types to this crucial process. Here, we used large-scale, serial section transmission electron microscopy (TEM) with computational volume segmentation to reconstruct the complete 3D morphologies of distinct glial types in the mouse visual cortex, providing unprecedented resolution of their morphology and composition. Unexpectedly, we discovered that the fine processes of oligodendrocyte precursor cells (OPCs), a population of abundant, highly dynamic glial progenitors, frequently surrounded small branches of axons. Numerous phagosomes and phagolysosomes (PLs) containing fragments of axons and vesicular structures were present inside their processes, suggesting that OPCs engage in axon pruning. Single-nucleus RNA sequencing from the developing mouse cortex revealed that OPCs express key phagocytic genes at this stage, as well as neuronal transcripts, consistent with active axon engulfment. Although microglia are thought to be responsible for the majority of synaptic pruning and structural refinement, PLs were ten times more abundant in OPCs than in microglia at this stage, and these structures were markedly less abundant in newly generated oligodendrocytes, suggesting that OPCs contribute substantially to the refinement of neuronal circuits during cortical development.

The clustering of neurons with similar response properties is a conspicuous feature of neocortex. In primary visual cortex (V1), maps of several properties like orientation preference are well described, but the functional architecture of color, central to visual perception in trichromatic primates, is not. Here we used two-photon calcium imaging in macaques to examine the fine structure of chromatic representation and found that neurons responsive to spatially uniform, chromatic stimuli form unambiguous clusters that coincide with blobs. Further, these responsive groups have marked substructure, segregating into smaller ensembles or micromaps with distinct chromatic signatures that appear columnar in upper layer 2/3. Spatially structured chromatic stimuli revealed maps built on the same micromap framework but with larger subdomains that go well beyond blobs. We conclude that V1 has an architecture for color representation that switches between blobs and a combined blob/interblob system based on the spatial content of the visual scene., Stimulus feature maps are found in primary visual cortex of many species. Here the authors show color maps in trichromatic primates containing segregated ensembles of neurons with distinct chromatic signatures that associate with cortical modules known as blobs.

Mammalian neocortex contains a highly diverse set of cell types. These types have been mapped systematically using a variety of molecular, electrophysiological and morphological approaches. Each modality offers new perspectives on the variation of biological processes underlying cell type specialization. While many morphological surveys focus on branching patterns of individual cells, fewer have been devoted to sub-cellular structure of cells. Electron microscopy (EM) provides dense ultrastructural examination and an unbiased perspective into the subcellular organization of brain cells, including their synaptic connectivity and nanometer scale morphology. Here we present the first systematic survey of the somatic region of nearly 100,000 cortical cells, using quantitative features obtained from EM. This analysis demonstrates a surprising sufficiency of the perisomatic region to recapitulate many known aspects of cortical organization, while also revealing novel relationships. Parameters of cell size, nuclear infolding and somatic synaptic innervation co-vary with distinct patterns across depth and between types. Further, we describe how these subcellular features can be used to create highly accurate predictions of cell-types across large scale EM datasets. More generally, our results suggest that the shifts in cellular physiology and molecular programming seen across cell types accompany profound differences in the fine-scale structure of cells.

The anatomy of the mammalian visual system, from the retina to the neocortex, is organized hierarchically1. However, direct observation of cellular-level functional interactions across this hierarchy is lacking due to the challenge of simultaneously recording activity across numerous regions. Here we describe a large, open dataset-part of the Allen Brain Observatory2-that surveys spiking from tens of thousands of units in six cortical and two thalamic regions in the brains of mice responding to a battery of visual stimuli. Using cross-correlation analysis, we reveal that the organization of inter-area functional connectivity during visual stimulation mirrors the anatomical hierarchy from the Allen Mouse Brain Connectivity Atlas3. We find that four classical hierarchical measures-response latency, receptive-field size, phase-locking to drifting gratings and response decay timescale-are all correlated with the hierarchy. Moreover, recordings obtained during a visual task reveal that the correlation between neural activity and behavioural choice also increases along the hierarchy. Our study provides a foundation for understanding coding and signal propagation across hierarchically organized cortical and thalamic visual areas.

Inhibitory neurons in mammalian cortex exhibit diverse physiological, morphological, molecular, and connectivity signatures. While considerable work has measured the average connectivity of several interneuron classes, there remains a fundamental lack of understanding of the connectivity distribution of distinct inhibitory cell types with synaptic resolution, how it relates to properties of target cells, and how it affects function. Here, we used large-scale electron microscopy and functional imaging to address these questions for chandelier cells in layer 2/3 of the mouse visual cortex. With dense reconstructions from electron microscopy, we mapped the complete chandelier input onto 153 pyramidal neurons. We found that synapse number is highly variable across the population and is correlated with several structural features of the target neuron. This variability in the number of axo-axonic ChC synapses is higher than the variability seen in perisomatic inhibition. Biophysical simulations show that the observed pattern of axo-axonic inhibition is particularly effective in controlling excitatory output when excitation and inhibition are co-active. Finally, we measured chandelier cell activity in awake animals using a cell-type-specific calcium imaging approach and saw highly correlated activity across chandelier cells. In the same experiments, in vivo chandelier population activity correlated with pupil dilation, a proxy for arousal. Together, these results suggest that chandelier cells provide a circuit-wide signal whose strength is adjusted relative to the properties of target neurons.

Light-sheet microscopy has emerged as the preferred means for high-throughput volumetric imaging of cleared tissues. However, there is a need for a user-friendly system that can address diverse imaging applications with varied requirements in terms of resolution (mesoscopic to sub-micron), sample geometry (size, shape, and number), and compatibility with tissue-clearing protocols of different refractive indices. We present a hybrid system that combines a novel non-orthogonal dual-objective and conventional open-top light-sheet architecture for highly versatile multi-scale volumetric imaging. One sentence summary Glaser et al. describe a hybrid open-top light-sheet microscope to image cleared tissues at mesoscopic to sub-micron resolution and depths of up to 1 cm.

To understand how the brain processes sensory information to guide behavior, we must know how stimulus representations are transformed throughout the visual cortex. Here we report an open, large-scale physiological survey of activity in the awake mouse visual cortex: the Allen Brain Observatory Visual Coding dataset. This publicly available dataset includes the cortical activity of nearly 60,000 neurons from six visual areas, four layers, and 12 transgenic mouse lines in a total of 243 adult mice, in response to a systematic set of visual stimuli. We classify neurons on the basis of joint reliabilities to multiple stimuli and validate this functional classification with models of visual responses. While most classes are characterized by responses to specific subsets of the stimuli, the largest class is not reliably responsive to any of the stimuli and becomes progressively larger in higher visual areas. These classes reveal a functional organization wherein putative dorsal areas show specialization for visual motion signals.

Light-sheet microscopy has emerged as the preferred means for high-throughput volumetric imaging of cleared tissues. However, there is a need for a flexible system that can address imaging applications with varied requirements in terms of resolution, sample size, tissue-clearing protocol, and transparent sample-holder material. Here, we present a 'hybrid' system that combines a unique non-orthogonal dual-objective and conventional (orthogonal) open-top light-sheet (OTLS) architecture for versatile multi-scale volumetric imaging. We demonstrate efficient screening and targeted sub-micrometer imaging of sparse axons within an intact, cleared mouse brain. The same system enables high-throughput automated imaging of multiple specimens, as spotlighted by a quantitative multi-scale analysis of brain metastases. Compared with existing academic and commercial light-sheet microscopy systems, our hybrid OTLS system provides a unique combination of versatility and performance necessary to satisfy the diverse requirements of a growing number of cleared-tissue imaging applications.

3D electron microscopy (EM) has been successful at mapping invertebrate nervous systems, but the approach has been limited to small chunks of mammalian brains. To scale up to larger volumes, we have built a computational pipeline for processing petascale image datasets acquired by serial section EM, a popular form of 3D EM. The pipeline employs convolutional nets to compute the nonsmooth transformations required to align images of serial sections containing numerous cracks and folds, detect neuronal boundaries, label voxels as axon, dendrite, soma, and other semantic categories, and detect synapses and assign them to presynaptic and postsynaptic segments. The output of neuronal boundary detection is segmented by mean affinity agglomeration with semantic and size constraints. Pipeline operations are implemented by leveraging distributed and cloud computing. Intermediate results of the pipeline are held in cloud storage, and can be effortlessly viewed as images, which aids debugging. We applied the pipeline to create an automated reconstruction of an EM image volume spanning four visual cortical areas of a mouse brain. Code for the pipeline is publicly available, as is the reconstructed volume.

To understand the brain we must relate neurons’ functional responses to the circuit architecture that shapes them. Here, we present a large functional connectomics dataset with dense calcium imaging of a millimeter scale volume. We recorded activity from approximately 75,000 neurons in primary visual cortex (VISp) and three higher visual areas (VISrl, VISal and VISlm) in an awake mouse viewing natural movies and synthetic stimuli. The functional data were co-registered with a volumetric electron microscopy (EM) reconstruction containing more than 200,000 cells and 0.5 billion synapses. Subsequent proofreading of a subset of neurons in this volume yielded reconstructions that include complete dendritic trees as well the local and inter-areal axonal projections that map up to thousands of cell-to-cell connections per neuron. Here, we release this dataset as an open-access resource to the scientific community including a set of tools that facilitate data retrieval and downstream analysis. In accompanying papers we describe our findings using the dataset to provide a comprehensive structural characterization of cortical cell types1–3and the most detailed synaptic level connectivity diagram of a cortical column to date2, uncovering unique cell-type specific inhibitory motifs that can be linked to gene expression data4. Functionally, we identify new computational principles of how information is integrated across visual space5, characterize novel types of neuronal invariances6and bring structure and function together to decipher a general principle that wires excitatory neurons within and across areas7, 8.

The motion/direction-sensitive and location-sensitive neurons are two major functional types in mouse visual thalamus that project to the primary visual cortex (V1). It has been proposed that the motion/direction-sensitive neurons mainly target the superficial layers in V1, in contrast to the location-sensitive neurons which mainly target the middle layers. Here, by imaging calcium activities of motion/direction-sensitive and location-sensitive axons in V1, we find no evidence for these cell-type specific laminar biases at population level. Furthermore, using a novel approach to reconstruct single-axon structures with identified in vivo response types, we show that, at single-axon level, the motion/direction-sensitive axons have middle layer preferences and project more densely to the middle layers than the location-sensitive axons. Overall, our results demonstrate that Motion/direction-sensitive thalamic neurons project extensively to the middle layers of V1, challenging the current view of the thalamocortical organizations in the mouse visual system.

Neurons in the developing brain undergo extensive structural refinement as nascent circuits adopt their mature form1. This transformation is facilitated by the engulfment and degradation of excess axonal branches and inappropriate synapses by surrounding glial cells, including microglia and astrocytes2,3. However, the small size of phagocytic organelles and the complex, highly ramified morphology of glia has made it difficult to determine the contribution of these and other glial cell types to this process. Here, we used large scale, serial electron microscopy (ssEM) with computational volume segmentation to reconstruct the complete 3D morphologies of distinct glial types in the mouse visual cortex. Unexpectedly, we discovered that the fine processes of oligodendrocyte precursor cells (OPCs), a population of abundant, highly dynamic glial progenitors4, frequently surrounded terminal axon branches and included numerous phagolysosomes (PLs) containing fragments of axons and presynaptic terminals. Single- nucleus RNA sequencing indicated that cortical OPCs express key phagocytic genes, as well as neuronal transcripts, consistent with active axonal engulfment. PLs were ten times more abundant in OPCs than in microglia in P36 mice, and declined with age and lineage progression, suggesting that OPCs contribute very substantially to refinement of neuronal circuits during later phases of cortical development.

Neurons in the developing brain undergo extensive structural refinement as nascent circuits adopt their mature form1. This transformation is facilitated by the engulfment and degradation of excess axonal branches and inappropriate synapses by surrounding glial cells, including microglia and astrocytes2,3. However, the small size of phagocytic organelles and the complex, highly ramified morphology of glia has made it difficult to determine the contribution of these and other glial cell types to this process. Here, we used large scale, serial electron microscopy (ssEM) with computational volume segmentation to reconstruct the complete 3D morphologies of distinct glial types in the mouse visual cortex. Unexpectedly, we discovered that the fine processes of oligodendrocyte precursor cells (OPCs), a population of abundant, highly dynamic glial progenitors4, frequently surrounded terminal axon branches and included numerous phagolysosomes (PLs) containing fragments of axons and presynaptic terminals. Single- nucleus RNA sequencing indicated that cortical OPCs express key phagocytic genes, as well as neuronal transcripts, consistent with active axonal engulfment. PLs were ten times more abundant in OPCs than in microglia in P36 mice, and declined with age and lineage progression, suggesting that OPCs contribute very substantially to refinement of neuronal circuits during later phases of cortical development.

SUMMARY Motion/direction-sensitive and location-sensitive neurons are the two major functional types in mouse visual thalamus that project to the primary visual cortex (V1). It is under debate whether motion/direction-sensitive inputs preferentially target the superficial layers in V1, as opposed to the location-sensitive inputs, which preferentially target the middle layers. Here, by using calcium imaging to measure the activity of motion/direction-sensitive and location-sensitive axons in V1, we find evidence against these cell-type-specific laminar biases at the population level. Furthermore, using an approach to reconstruct axon arbors with identified in vivo response types, we show that, at the single-axon level, the motion/direction-sensitive axons project more densely to the middle layers than the location-sensitive axons. Overall, our results demonstrate that motion/direction-sensitive thalamic neurons project extensively to the middle layers of V1 at both the population and single-cell levels, providing further insight into the organization of thalamocortical projection in the mouse visual system., In brief Zhuang et al., investigate the functionally specific thalamocortical projection patterns in mouse primary visual cortex at both the population and single-axon levels. They find that the motion/direction-sensitive axons project extensively to the middle layers of primary visual cortex, challenging an existing hypothesis proposing a superficial targeting bias of these axons., Graphical Abstract

Fluorescent calcium indicators are often used to investigate neural dynamics, but the relationship between fluorescence and action potentials (APs) remains unclear. Most APs can be detected when the soma almost fills the microscope’s field of view, but calcium indicators are used to image populations of neurons, necessitating a large field of view, generating fewer photons per neuron, and compromising AP detection. Here, we characterized the AP-fluorescence transfer function in vivo for 48 layer 2/3 pyramidal neurons in primary visual cortex, with simultaneous calcium imaging and cell-attached recordings from transgenic mice expressing GCaMP6s or GCaMP6f. While most APs were detected under optimal conditions, under conditions typical of population imaging studies, only a minority of 1 AP and 2 AP events were detected (often, eLife digest Neurons, the cells that make up the nervous system, transmit information using electrical signals known as action potentials or spikes. Studying the spiking patterns of neurons in the brain is essential to understand perception, memory, thought, and behaviour. One way to do that is by recording electrical activity with microelectrodes. Another way to study neuronal activity is by using molecules that change how they interact with light when calcium binds to them, since changes in calcium concentration can be indicative of neuronal spiking. That change can be observed with specialized microscopes know as two-photon fluorescence microscopes. Using calcium indicators, it is possible to simultaneously record hundreds or even thousands of neurons. However, calcium fluorescence and spikes do not translate one-to-one. In order to interpret fluorescence data, it is important to understand the relationship between the fluorescence signals and the spikes associated with individual neurons. The only way to directly measure this relationship is by using calcium imaging and electrical recording simultaneously to record activity from the same neuron. However, this is extremely challenging experimentally, so this type of data is rare. To shed some light on this, Huang, Ledochowitsch et al. used mice that had been genetically modified to produce a calcium indicator in neurons of the visual cortex and simultaneously obtained both fluorescence measurements and electrical recordings from these neurons. These experiments revealed that, while the majority of time periods containing multi-spike neural activity could be identified using calcium imaging microscopy, on average, less than 10% of isolated single spikes were detectable. This is an important caveat that researchers need to take into consideration when interpreting calcium imaging results. These findings are intended to serve as a guide for interpreting calcium imaging studies that look at neurons in the mammalian brain at the population level. In addition, the data provided will be useful as a reference for the development of activity sensors, and to benchmark and improve computational approaches for detecting and predicting spikes.

We are applying light-sheet fluorescence microscopy with scanned Bessel beam illumination and confocal slit detection, combined with tissue expansion microscopy, to image dense axons over large brain volumes for axonal connectomics.

SummaryWe present a semi-automated reconstruction of L2/3 mouse primary visual cortex from 3 million cubic microns of electron microscopic images, including pyramidal and inhibitory neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are being made publicly available, along with tools for programmatic and 3D interactive access. The density of synaptic inputs onto inhibitory neurons varies across cell classes and compartments. We uncover a compartment-specific correlation between mitochondrial coverage and synapse density. Frequencies of connectivity motifs in the graph of pyramidal cells are predicted quite accurately from node degrees using the configuration model of random graphs. Cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. These example findings illustrate the resource’s utility for relating structure and function of cortical circuits as well as for neuronal cell biology.

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

Light-sheet microscopy has emerged as the preferred means for high-throughput volumetric imaging of cleared tissues. However, there is a need for a user-friendly system that can address diverse imaging applications with varied requirements in terms of resolution (mesoscopic to sub-micron), sample geometry (size, shape, and number), and compatibility with tissue-clearing protocols of different refractive indices. We present a hybrid system that combines a novel non-orthogonal dual-objective and conventional open-top light-sheet architecture for highly versatile multi-scale volumetric imaging. One sentence summary Glaser et al. describe a hybrid open-top light-sheet microscope to image cleared tissues at mesoscopic to sub-micron resolution and depths of up to 1 cm.

Combining two-photon calcium imaging (2PCI) and electron microscopy (EM) provides arguably the most powerful current approach for connecting function to structure in neural circuits. Recent years have seen dramatic advances in obtaining and processing CI and EM data separately. In addition, several joint CI-EM datasets (with CI performed in vivo, followed by EM reconstruction of the same volume) have been collected. However, no automated analysis tools yet exist that can match each signal extracted from the CI data to a cell segment extracted from EM; previous efforts have been largely manual and focused on analyzing calcium activity in cell bodies, neglecting potentially rich functional information from axons and dendrites. There are two major roadblocks to solving this matching problem: first, dense EM reconstruction extracts orders of magnitude more segments than are visible in the corresponding CI field of view, and second, due to optical constraints and non-uniform brightness of the calcium indicator in each cell, direct matching of EM and CI spatial components is nontrivial.In this work we develop a pipeline for fusing CI and densely-reconstructed EM data. We model the observed CI data using a constrained nonnegative matrix factorization (CNMF) framework, in which segments extracted from the EM reconstruction serve to initialize and constrain the spatial components of the matrix factorization. We develop an efficient iterative procedure for solving the resulting combined matching and matrix factorization problem and apply this procedure to joint CI-EM data from mouse visual cortex. The method recovers hundreds of dendritic components from the CI data, visible across multiple functional scans at different depths, matched with densely-reconstructed three-dimensional neural segments recovered from the EM volume. We publicly release the output of this analysis as a new gold standard dataset that can be used to score algorithms for demixing signals from 2PCI data. Finally, we show that this database can be exploited to (1) learn a mapping from 3d EM segmentations to predict the corresponding 2d spatial components estimated from CI data, and (2) train a neural network to denoise these estimated spatial components. This neural network denoiser is a stand-alone module that can be dropped in to enhance any existing 2PCI analysis pipeline.

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ~250×140×90 μm(3) of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.