Search

Abstract Pairwise image registration is a necessary prerequisite for brain image comparison and data integration in neuroscience and radiology. In this work, we explore the efficacy of implicit neural representations (INRs) in improving the performance of brain image registration in magnetic resonance imaging. In this setting, INRs serve as a continuous and coordinate based approximation of the deformation field obtained through a multi-layer perceptron. Previous research has demonstrated that sinusoidal representation networks (SIRENs) surpass ReLU models in performance. In this study, we first broaden the range of activation functions to further investigate the registration performance of implicit networks equipped with activation functions that exhibit diverse oscillatory properties. Specifically, in addition to the SIRENs and ReLU, we evaluate activation functions based on snake, sine+, chirp and Morlet wavelet functions. Second, we conduct experiments to relate the hyper-parameters of the models to registration performance. Third, we propose and assess various techniques, including cycle consistency loss, ensembles and cascades of implicit networks, as well as a combined image fusion and registration objective, to enhance the performance of implicit registration networks beyond the standard approach. The investigated implicit methods are compared to the VoxelMorph convolutional neural network and to the symmetric image normalization (SyN) registration algorithm from the Advanced Normalization Tools (ANTs). Our findings not only highlight the remarkable capabilities of implicit networks in addressing pairwise image registration challenges, but also showcase their potential as a powerful and versatile off-the-shelf tool in the fields of neuroscience and radiology.

Abstract Magnetic resonance imaging (MRI) is a non-invasive neuroimaging technique that is useful for identifying normal developmental and aging processes and for data sharing. Marmosets have a relatively shorter life expectancy than other primates, including humans, because they grow and age faster. Therefore, the common marmoset model is effective in aging research. The current study investigated the aging process of the marmoset brain and provided an open MRI database of marmosets across a wide age range. The Brain/MINDS Marmoset Brain MRI Dataset contains brain MRI information from 216 marmosets ranging in age from 1 and 10 years. At the time of its release, it is the largest public dataset in the world. It also includes multi-contrast MRI images. In addition, 91 of 216 animals have corresponding high-resolution ex vivo MRI datasets. Our MRI database, available at the Brain/MINDS Data Portal, might help to understand the effects of various factors, such as age, sex, body size, and fixation, on the brain. It can also contribute to and accelerate brain science studies worldwide.

Summary: The paraventricular nucleus of the thalamus (PVT) projects axons to multiple areas, mediates a wide range of behaviors, and exhibits regional heterogeneity in both functions and axonal projections. Still, questions regarding the cell types present in the PVT and the extent of their differences remain inadequately addressed. We applied single-cell RNA sequencing to depict the transcriptomic characteristics of mouse PVT neurons. We found that one of the most significant variances in the PVT transcriptome corresponded to the anterior-posterior axis. While the single-cell transcriptome classified PVT neurons into five types, our transcriptomic and histological analyses showed continuity among the cell types. We discovered that anterior and posterior subpopulations had nearly non-overlapping projection patterns, while another population showed intermediate patterns. In addition, these subpopulations responded differently to appetite-related neuropeptides, with their activation showing opposing effects on food consumption. Our studies unveiled the contrasts and the continuity of PVT neurons that underpin their function.

Background: Understanding prefrontal cortex projections to diencephalic-mesencephalic junction (DMJ), especially to subthalamic nucleus (STN) and ventral mesencephalic tegmentum (VMT) helps our comprehension of Deep Brain Stimulation (DBS) in major depression (MD) and obsessive-compulsive disorder (OCD). Fiber routes are complex and tract tracing studies in non-human primate species (NHP) have yielded conflicting results. The superolateral medial forebrain bundle (slMFB) is a promising target for DBS in MD and OCD. It has become a focus of criticism owing to its name and its diffusion weighted-imaging based primary description. Objective: To investigate DMJ connectivity in NHP with a special focus on slMFB and the limbic hyperdirect pathway utilizing three-dimensional and data driven techniques. Methods: We performed left prefrontal adeno-associated virus - tracer based injections in the common marmoset monkey (n = 52). Histology and two-photon microscopy were integrated into a common space. Manual and data driven cluster analyses of DMJ, subthalamic nucleus and VMT together, followed by anterior tract tracing streamline (ATTS) tractography were deployed. Results: Typical pre- and supplementary motor hyperdirect connectivity was confirmed. The advanced tract tracing unraveled the complex connectivity to the DMJ. Limbic prefrontal territories directly projected to the VMT but not STN. Discussion: Intricate results of tract tracing studies warrant the application of advanced three-dimensional analyses to understand complex fiber-anatomical routes. The applied three-dimensional techniques can enhance anatomical understanding also in other regions with complex fiber anatomy. Conclusion: Our work confirms slMFB anatomy and enfeebles previous misconceptions. The rigorous NHP approach strengthens the role of the slMFB as a target structure for DBS predominantly in psychiatric indications like MD and OCD.

Abstract We present MiniVess, the first annotated dataset of rodent cerebrovasculature, acquired using two-photon fluorescence microscopy. MiniVess consists of 70 3D image volumes with segmented ground truths. Segmentations were created using traditional image processing operations, a U-Net, and manual proofreading. Code for image preprocessing steps and the U-Net are provided. Supervised machine learning methods have been widely used for automated image processing of biomedical images. While much emphasis has been placed on the development of new network architectures and loss functions, there has been an increased emphasis on the need for publicly available annotated, or segmented, datasets. Annotated datasets are necessary during model training and validation. In particular, datasets that are collected from different labs are necessary to test the generalizability of models. We hope this dataset will be helpful in testing the reliability of machine learning tools for analyzing biomedical images.

In building biological neural network models, it is crucial to efficiently convert diverse anatomical and physiological data into parameters of neurons and synapses and to systematically estimate unknown parameters in reference to experimental observations. Web-based tools for systematic model building can improve the transparency and reproducibility of computational models and can facilitate collaborative model building, validation, and evolution. Here, we present a framework to support collaborative data-driven development of spiking neural network (SNN) models based on the Entity-Relationship (ER) data description commonly used in large-scale business software development. We organize all data attributes, including species, brain regions, neuron types, projections, neuron models, and references as tables and relations within a database management system (DBMS) and provide GUI interfaces for data registration and visualization. This allows a robust “business-oriented” data representation that supports collaborative model building and traceability of source information for every detail of a model. We tested this data-to-model framework in cortical and striatal network models by successfully combining data from papers with existing neuron and synapse models and by generating NEST simulation codes for various network sizes. Our framework also helps to check data integrity and consistency and data comparisons across species. The framework enables the modeling of any region of the brain and is being deployed to support the integration of anatomical and physiological datasets from the brain/MINDS project for systematic SNN modeling of the marmoset brain.

Abstract Diffusion-weighted magnetic resonance imaging (dMRI) allows non-invasive investigation of whole-brain connectivity, which can reveal the brain’s global network architecture and also abnormalities involved in neurological and mental disorders. However, the reliability of connection inferences from dMRI-based fiber tracking is still debated, due to low sensitivity, dominance of false positives, and inaccurate and incomplete reconstruction of long-range connections. Furthermore, parameters of tracking algorithms are typically tuned in a heuristic way, which leaves room for manipulation of an intended result. Here we propose a general data-driven framework to optimize and validate parameters of dMRI-based fiber tracking algorithms using neural tracer data as a reference. Japan’s Brain/MINDS Project provides invaluable datasets containing both dMRI and neural tracer data from the same primates. A fundamental difference when comparing dMRI-based tractography and neural tracer data is that the former cannot specify the direction of connectivity; therefore, evaluating the fitting of dMRI-based tractography becomes challenging. The framework implements multi-objective optimization based on the non-dominated sorting genetic algorithm II. Its performance is examined in two experiments using data from ten subjects for optimization and six for testing generalization. The first uses a seed-based tracking algorithm, iFOD2, and objectives for sensitivity and specificity of region-level connectivity. The second uses a global tracking algorithm and a more refined set of objectives: distance-weighted coverage, true/false positive ratio, projection coincidence, and commissural passage. In both experiments, with optimized parameters compared to default parameters, fiber tracking performance was significantly improved in coverage and fiber length. Improvements were more prominent using global tracking with refined objectives, achieving an average fiber length from 10 to 17 mm, voxel-wise coverage of axonal tracts from 0.9 to 15%, and the correlation of target areas from 40 to 68%, while minimizing false positives and impossible cross-hemisphere connections. Optimized parameters showed good generalization capability for test brain samples in both experiments, demonstrating the flexible applicability of our framework to different tracking algorithms and objectives. These results indicate the importance of data-driven adjustment of fiber tracking algorithms and support the validity of dMRI-based tractography, if appropriate adjustments are employed.