Search

In this perspective article, we consider the critical issue of data and other research object standardisation and, specifically, how international collaboration, and organizations such as the International Neuroinformatics Coordinating Facility (INCF) can encourage that emerging neuroscience data be Findable, Accessible, Interoperable, and Reusable (FAIR). As neuroscientists engaged in the sharing and integration of multi-modal and multiscale data, we see the current insufficiency of standards as a major impediment in the Interoperability and Reusability of research results. We call for increased international collaborative standardisation of neuroscience data to foster integration and efficient reuse of research objects.

There is great need for coordination around standards and best practices in neuroscience to support efforts to make neuroscience a data-centric discipline. Major brain initiatives launched around the world are poised to generate huge stores of neuroscience data. At the same time, neuroscience, like many domains in biomedicine, is confronting the issues of transparency, rigor, and reproducibility. Widely used, validated standards and best practices are key to addressing the challenges in both big and small data science, as they are essential for integrating diverse data and for developing a robust, effective, and sustainable infrastructure to support open and reproducible neuroscience. However, developing community standards and gaining their adoption is difficult. The current landscape is characterized both by a lack of robust, validated standards and a plethora of overlapping, underdeveloped, untested and underutilized standards and best practices. The International Neuroinformatics Coordinating Facility (INCF), an independent organization dedicated to promoting data sharing through the coordination of infrastructure and standards, has recently implemented a formal procedure for evaluating and endorsing community standards and best practices in support of the FAIR principles. By formally serving as a standards organization dedicated to open and FAIR neuroscience, INCF helps evaluate, promulgate, and coordinate standards and best practices across neuroscience. Here, we provide an overview of the process and discuss how neuroscience can benefit from having a dedicated standards body.

The Adolescent Brain Cognitive Development (ABCD) Study is the largest single-cohort prospective longitudinal study of neurodevelopment and children's health in the United States. A cohort of n = 11,880 children aged 9-10 years (and their parents/guardians) were recruited across 22 sites and are being followed with in-person visits on an annual basis for at least 10 years. The study approximates the US population on several key sociodemographic variables, including sex, race, ethnicity, household income, and parental education. Data collected include assessments of health, mental health, substance use, culture and environment and neurocognition, as well as geocoded exposures, structural and functional magnetic resonance imaging (MRI), and whole-genome genotyping. Here, we describe the ABCD Study aims and design, as well as issues surrounding estimation of meaningful associations using its data, including population inferences, hypothesis testing, power and precision, control of covariates, interpretation of associations, and recommended best practices for reproducible research, analytical procedures and reporting of results.

The Adolescent Brain Cognitive Development (ABCD) Study is an ongoing, nationwide study of the effects of environmental influences on behavioral and brain development in adolescents. The main objective of the study is to recruit and assess over eleven thousand 9-10-year-olds and follow them over the course of 10 years to characterize normative brain and cognitive development, the many factors that influence brain development, and the effects of those factors on mental health and other outcomes. The study employs state-of-the-art multimodal brain imaging, cognitive and clinical assessments, bioassays, and careful assessment of substance use, environment, psychopathological symptoms, and social functioning. The data is a resource of unprecedented scale and depth for studying typical and atypical development. The aim of this manuscript is to describe the baseline neuroimaging processing and subject-level analysis methods used by ABCD. Processing and analyses include modality-specific corrections for distortions and motion, brain segmentation and cortical surface reconstruction derived from structural magnetic resonance imaging (sMRI), analysis of brain microstructure using diffusion MRI (dMRI), task-related analysis of functional MRI (fMRI), and functional connectivity analysis of resting-state fMRI. This manuscript serves as a methodological reference for users of publicly shared neuroimaging data from the ABCD Study.

There has been a recent major upsurge in the concerns about reproducibility in many areas of science. Within the neuroimaging domain, one approach is to promote reproducibility is to target the re-executability of the publication. The information supporting such re-executability can enable the detailed examination of how an initial finding generalizes across changes in the processing approach, and sampled population, in a controlled scientific fashion. ReproNim: A Center for Reproducible Neuroimaging Computation is a recently funded initiative that seeks to facilitate the "last mile" implementations of core re-executability tools in order to reduce the accessibility barrier and increase adoption of standards and best practices at the neuroimaging research laboratory level. In this report, we summarize the overall approach and tools we have developed in this domain.

Reproducible research is a key element of the scientific process. Re-executability of neuroimaging workflows that lead to the conclusions arrived at in the literature has not yet been sufficiently addressed and adopted by the neuroimaging community. In this paper, we document a set of procedures, which include supplemental additions to a manuscript, that unambiguously define the data, workflow, execution environment and results of a neuroimaging analysis, in order to generate a verifiable re-executable publication. Re-executability provides a starting point for examination of the generalizability and reproducibility of a given finding.

ObjectiveThe aims of the current study were to determine whether children with the 6 different APOE ε genotypes show differences in gray matter maturation, particularly for those with ε4 and ε2 alleles, which are associated with poorer outcomes in many neurologic disorders.MethodsA total of 1,187 healthy children (aged 3-20 years, 52.1% boys, 47.9% girls) with acceptable data from the cross-sectional Pediatric Imaging Neurocognition and Genetics Study were evaluated for the effects of 6 APOE ε genotypes on macroscopic and microscopic cortical and subcortical gray matter structures (measured with 3-tesla MRI and FreeSurfer for automated morphometry) and on cognition (NIH Toolbox).ResultsAmong APOE ε4 carriers, age-related changes in brain structures and cognition varied depending on genotype, with the smallest hippocampi in ε2ε4 children, the lowest hippocampal fractional anisotropy in younger ε4ε4 children, the largest medial orbitofrontal cortical areas in ε3ε4 children, and age-dependent thinning of the entorhinal cortex in ε4ε4 children. Younger ε4ε4 children had the lowest scores on executive function and working memory, while younger ε2ε4 children performed worse on attention tasks. Larger parietal gyri in the younger ε2ε4 children, and thinner temporal and cingulate isthmus cortices or smaller hippocampi in the younger ε4ε4 children, predicted poorer performance on attention or working memory.ConclusionsOur findings validated and extended prior smaller studies that showed altered brain development in APOE ε4-carrier children. The ε4ε4 and ε2ε4 genotypes may negatively influence brain development and brain aging at the extremes of age. Studying APOE ε polymorphisms in young children may provide the earliest indicators for individuals who might benefit from early interventions or preventive measures for future brain injuries and dementia.

ObjectiveThe aims of the current study were to determine whether children with the 6 different APOE ε genotypes show differences in gray matter maturation, particularly for those with ε4 and ε2 alleles, which are associated with poorer outcomes in many neurologic disorders.MethodsA total of 1,187 healthy children (aged 3-20 years, 52.1% boys, 47.9% girls) with acceptable data from the cross-sectional Pediatric Imaging Neurocognition and Genetics Study were evaluated for the effects of 6 APOE ε genotypes on macroscopic and microscopic cortical and subcortical gray matter structures (measured with 3-tesla MRI and FreeSurfer for automated morphometry) and on cognition (NIH Toolbox).ResultsAmong APOE ε4 carriers, age-related changes in brain structures and cognition varied depending on genotype, with the smallest hippocampi in ε2ε4 children, the lowest hippocampal fractional anisotropy in younger ε4ε4 children, the largest medial orbitofrontal cortical areas in ε3ε4 children, and age-dependent thinning of the entorhinal cortex in ε4ε4 children. Younger ε4ε4 children had the lowest scores on executive function and working memory, while younger ε2ε4 children performed worse on attention tasks. Larger parietal gyri in the younger ε2ε4 children, and thinner temporal and cingulate isthmus cortices or smaller hippocampi in the younger ε4ε4 children, predicted poorer performance on attention or working memory.ConclusionsOur findings validated and extended prior smaller studies that showed altered brain development in APOE ε4-carrier children. The ε4ε4 and ε2ε4 genotypes may negatively influence brain development and brain aging at the extremes of age. Studying APOE ε polymorphisms in young children may provide the earliest indicators for individuals who might benefit from early interventions or preventive measures for future brain injuries and dementia.

Anxiety is a risk factor for many adverse neuropsychiatric and socioeconomic outcomes, and has been linked to functional and structural changes in the ventromedial prefrontal cortex (VMPFC). However, the nature of these differences, as well as how they develop in children and adolescents, remains poorly understood. More effective interventions to minimize the negative consequences of anxiety require better understanding of its neurobiology in children. Recent research suggests that structural imaging studies may benefit from clearly delineating between cortical surface area and thickness when examining these associations, as these distinct cortical phenotypes are influenced by different cellular mechanisms and genetic factors. The present study examined relationships between cortical surface area and thickness of the VMPFC and a self-report measure of anxiety (SCARED-R) in 287 youths aged 7-20 years from the Pediatric Imaging, Neurocognition, and Genetics (PING) study. Age and gender interactions were examined for significant associations in order to test for developmental differences. Cortical surface area and thickness were also examined simultaneously to determine whether they contribute independently to the prediction of anxiety. Anxiety was negatively associated with relative cortical surface area of the VMPFC as well as with global cortical thickness, but these associations diminished with age. The two cortical phenotypes contributed additively to the prediction of anxiety. These findings suggest that higher anxiety in children may be characterized by both delayed expansion of the VMPFC and an altered trajectory of global cortical thinning. Further longitudinal studies will be needed to confirm these findings.

A central tenet in support of research reproducibility is the ability to uniquely identify research resources, i.e., reagents, tools, and materials that are used to perform experiments. However, current reporting practices for research resources are insufficient to identify the exact resources that are reported or to answer basic questions such as "How did other studies use resource X?" To address this issue, the Resource Identification Initiative was launched as a pilot project to improve the reporting standards for research resources in the methods sections of papers and thereby improve identifiability and scientific reproducibility. The pilot engaged over 25 biomedical journal editors from most major publishers, as well as scientists and funding officials. Authors were asked to include Research Resource Identifiers (RRIDs) in their manuscripts prior to publication for three resource types: antibodies, model organisms, and tools (i.e., software and databases). RRIDs are assigned by an authoritative database, for example a model organism database, for each type of resource. To make it easier for authors to obtain RRIDs, resources were aggregated from the appropriate databases and their RRIDs made available in a central web portal ( http://scicrunch.org/resources ). RRIDs meet three key criteria: they are machine readable, free to generate and access, and are consistent across publishers and journals. The pilot was launched in February of 2014 and over 300 papers have appeared that report RRIDs. The number of journals participating has expanded from the original 25 to more than 40 with RRIDs appearing in 62 different journals to date. Here, we present an overview of the pilot project and its outcomes to date. We show that authors are able to identify resources and are supportive of the goals of the project. Identifiability of the resources post-pilot showed a dramatic improvement for all three resource types, suggesting that the project has had a significant impact on identifiability of research resources.

The main objective of the multi-site Pediatric Imaging, Neurocognition, and Genetics (PING) study was to create a large repository of standardized measurements of behavioral and imaging phenotypes accompanied by whole genome genotyping acquired from typically-developing children varying widely in age (3 to 20 years). This cross-sectional study produced sharable data from 1493 children, and these data have been described in several publications focusing on brain and cognitive development. Researchers may gain access to these data by applying for an account on the PING portal and filing a data use agreement. Here we describe the recruiting and screening of the children and give a brief overview of the assessments performed, the imaging methods applied, the genetic data produced, and the numbers of cases for whom different data types are available. We also cite sources of more detailed information about the methods and data. Finally we describe the procedures for accessing the data and for using the PING data exploration portal.

Socioeconomic disparities are associated with differences in cognitive development. The extent to which this translates to disparities in brain structure is unclear. We investigated relationships between socioeconomic factors and brain morphometry, independently of genetic ancestry, among a cohort of 1,099 typically developing individuals between 3 and 20 years of age. Income was logarithmically associated with brain surface area. Among children from lower income families, small differences in income were associated with relatively large differences in surface area, whereas, among children from higher income families, similar income increments were associated with smaller differences in surface area. These relationships were most prominent in regions supporting language, reading, executive functions and spatial skills; surface area mediated socioeconomic differences in certain neurocognitive abilities. These data imply that income relates most strongly to brain structure among the most disadvantaged children.

A central tenet in support of research reproducibility is the ability to uniquely identify research resources, i.e., reagents, tools, and materials that are used to perform experiments. However, current reporting practices for research resources are insufficient to allow humans and algorithms to identify the exact resources that are reported or answer basic questions such as "What other studies used resource X?" To address this issue, the Resource Identification Initiative was launched as a pilot project to improve the reporting standards for research resources in the methods sections of papers and thereby improve identifiability and reproducibility. The pilot engaged over 25 biomedical journal editors from most major publishers, as well as scientists and funding officials. Authors were asked to include Research Resource Identifiers (RRIDs) in their manuscripts prior to publication for three resource types: antibodies, model organisms, and tools (including software and databases). RRIDs represent accession numbers assigned by an authoritative database, e.g., the model organism databases, for each type of resource. To make it easier for authors to obtain RRIDs, resources were aggregated from the appropriate databases and their RRIDs made available in a central web portal ( www.scicrunch.org/resources). RRIDs meet three key criteria: they are machine readable, free to generate and access, and are consistent across publishers and journals. The pilot was launched in February of 2014 and over 300 papers have appeared that report RRIDs. The number of journals participating has expanded from the original 25 to more than 40. Here, we present an overview of the pilot project and its outcomes to date. We show that authors are generally accurate in performing the task of identifying resources and supportive of the goals of the project. We also show that identifiability of the resources pre- and post-pilot showed a dramatic improvement for all three resource types, suggesting that the project has had a significant impact on reproducibility relating to research resources.

This article provides guidelines for universities to incorporate data and software contributions into their hiring, promotion, and tenure processes. It emphasizes the importance of aligning evaluation processes with open science principles and valuing diverse scholarly contributions. The guidelines include recommendations for developing clear guidelines for committee members, selecting a suitable committee with expertise in open data and software, and articulating metrics for evaluation. The document acknowledges that data and software competency is just one factor to consider and encourages institutions to balance it with other relevant factors. [Extracted from the article]

ObjectiveThe NIH Toolbox Cognition Battery (NTCB) was designed to provide a brief, efficient computerized test of key neuropsychological functions appropriate for use in children as young as 3 years of age. This report describes the performance of a large group of typically developing children and adolescents and examines the impact of age and sociocultural variables on test performance.MethodThe NTCB was administered to a sample of 1,020 typically developing males and females ranging in age from 3 to 20 years, diverse in terms of socioeconomic status (SES) and race/ethnicity, as part of the new publicly accessible Pediatric Imaging, Neurocognition, and Genetics (PING) data resource, at 9 sites across the United States.ResultsGeneral additive models of nonlinear age-functions were estimated from age-differences in test performance on the 8 NTCB subtests while controlling for family SES and genetic ancestry factors (GAFs). Age accounted for the majority of the variance across all NTCB scores, with additional significant contributions of gender on some measures, and of SES and race/ethnicity (GAFs) on all. After adjusting for age and gender, SES and GAFs explained a substantial proportion of the remaining unexplained variance in Picture Vocabulary scores.ConclusionsThe results highlight the sensitivity to developmental effects and efficiency of this new computerized assessment battery for neurodevelopmental research. Limitations are observed in the form of some ceiling effects in older children, some floor effects, particularly on executive function tests in the youngest participants, and evidence for variable measurement sensitivity to cultural/socioeconomic factors.

In recent years, there has been growing enthusiasm that functional magnetic resonance imaging (MRI) could achieve clinical utility for a broad range of neuropsychiatric disorders. However, several barriers remain. For example, the acquisition of large-scale datasets capable of clarifying the marked heterogeneity that exists in psychiatric illnesses will need to be realized. In addition, there continues to be a need for the development of image processing and analysis methods capable of separating signal from artifact. As a prototypical hyperkinetic disorder, and movement-related artifact being a significant confound in functional imaging studies, ADHD offers a unique challenge. As part of the ADHD-200 Global Competition and this special edition of Frontiers, the ADHD-200 Consortium demonstrates the utility of an aggregate dataset pooled across five institutions in addressing these challenges. The work aimed to (1) examine the impact of emerging techniques for controlling for "micro-movements," and (2) provide novel insights into the neural correlates of ADHD subtypes. Using support vector machine (SVM)-based multivariate pattern analysis (MVPA) we show that functional connectivity patterns in individuals are capable of differentiating the two most prominent ADHD subtypes. The application of graph-theory revealed that the Combined (ADHD-C) and Inattentive (ADHD-I) subtypes demonstrated some overlapping (particularly sensorimotor systems), but unique patterns of atypical connectivity. For ADHD-C, atypical connectivity was prominent in midline default network components, as well as insular cortex; in contrast, the ADHD-I group exhibited atypical patterns within the dlPFC regions and cerebellum. Systematic motion-related artifact was noted, and highlighted the need for stringent motion correction. Findings reported were robust to the specific motion correction strategy employed. These data suggest that resting-state functional connectivity MRI (rs-fcMRI) data can be used to characterize individual patients with ADHD and to identify neural distinctions underlying the clinical heterogeneity of ADHD.

Structural MRI allows unparalleled in vivo study of the anatomy of the developing human brain. For more than two decades, MRI research has revealed many new aspects of this multifaceted maturation process, significantly augmenting scientific knowledge gathered from postmortem studies. Postnatal brain development is notably protracted and involves considerable changes in cerebral cortical, subcortical, and cerebellar structures, as well as significant architectural changes in white matter fiber tracts (see [12]). Although much work has described isolated features of neuroanatomical development, it remains a critical challenge to characterize the multidimensional nature of brain anatomy, capturing different phases of development among individuals. Capitalizing on key advances in multisite, multimodal MRI, and using cross-validated nonlinear modeling, we demonstrate that developmental brain phase can be assessed with much greater precision than has been possible using other biological measures, accounting for more than 92% of the variance in age. Further, our composite metric of morphology, diffusivity, and signal intensity shows that the average difference in phase among children of the same age is only about 1 year, revealing for the first time a latent phenotype in the human brain for which maturation timing is tightly controlled.

Significant resources around the world have been invested in neuroimaging studies of brain function and disease. Easier access to this large body of work should have profound impact on research in cognitive neuroscience and psychiatry, leading to advances in the diagnosis and treatment of psychiatric and neurological disease. A trend toward increased sharing of neuroimaging data has emerged in recent years. Nevertheless, a number of barriers continue to impede momentum. Many researchers and institutions remain uncertain about how to share data or lack the tools and expertise to participate in data sharing. The use of electronic data capture (EDC) methods for neuroimaging greatly simplifies the task of data collection and has the potential to help standardize many aspects of data sharing. We review here the motivations for sharing neuroimaging data, the current data sharing landscape, and the sociological or technical barriers that still need to be addressed. The INCF Task Force on Neuroimaging Datasharing, in conjunction with several collaborative groups around the world, has started work on several tools to ease and eventually automate the practice of data sharing. It is hoped that such tools will allow researchers to easily share raw, processed, and derived neuroimaging data, with appropriate metadata and provenance records, and will improve the reproducibility of neuroimaging studies. By providing seamless integration of data sharing and analysis tools within a commodity research environment, the Task Force seeks to identify and minimize barriers to data sharing in the field of neuroimaging.

Visual cortical surface area varies two- to threefold between human individuals, is highly heritable, and has been correlated with visual acuity and visual perception. However, it is still largely unknown what specific genetic and environmental factors contribute to normal variation in the area of visual cortex. To identify SNPs associated with the proportional surface area of visual cortex, we performed a genome-wide association study followed by replication in two independent cohorts. We identified one SNP (rs6116869) that replicated in both cohorts and had genome-wide significant association (P(combined) = 3.2 × 10(-8)). Furthermore, a metaanalysis of imputed SNPs in this genomic region identified a more significantly associated SNP (rs238295; P = 6.5 × 10(-9)) that was in strong linkage disequilibrium with rs6116869. These SNPs are located within 4 kb of the 5' UTR of GPCPD1, glycerophosphocholine phosphodiesterase GDE1 homolog (Saccharomyces cerevisiae), which in humans, is more highly expressed in occipital cortex compared with the remainder of cortex than 99.9% of genes genome-wide. Based on these findings, we conclude that this common genetic variation contributes to the proportional area of human visual cortex. We suggest that identifying genes that contribute to normal cortical architecture provides a first step to understanding genetic mechanisms that underlie visual perception.

In recent years, there has been growing enthusiasm that functional magnetic resonance imaging (MRI) could achieve clinical utility for a broad range of neuropsychiatric disorders. However, several barriers remain. For example, the acquisition of large-scale datasets capable of clarifying the marked heterogeneity that exists in psychiatric illnesses will need to be realized. In addition, there continues to be a need for the development of image processing and analysis methods capable of separating signal from artifact. As a prototypical hyperkinetic disorder, and movement-related artifact being a significant confound in functional imaging studies, ADHD offers a unique challenge. As part of the ADHD-200 Global Competition and this special edition of Frontiers, the ADHD-200 Consortium demonstrates the utility of an aggregate dataset pooled across five institutions in addressing these challenges. The work aimed to (1) examine the impact of emerging techniques for controlling for "micro-movements," and (2) provide novel insights into the neural correlates of ADHD subtypes. Using support vector machine (SVM)-based multivariate pattern analysis (MVPA) we show that functional connectivity patterns in individuals are capable of differentiating the two most prominent ADHD subtypes. The application of graph-theory revealed that the Combined (ADHD-C) and Inattentive (ADHD-I) subtypes demonstrated some overlapping (particularly sensorimotor systems), but unique patterns of atypical connectivity. For ADHD-C, atypical connectivity was prominent in midline default network components, as well as insular cortex; in contrast, the ADHD-I group exhibited atypical patterns within the dlPFC regions and cerebellum. Systematic motion-related artifact was noted, and highlighted the need for stringent motion correction. Findings reported were robust to the specific motion correction strategy employed. These data suggest that resting-state functional connectivity MRI (rs-fcMRI) data can be used to characterize individual patients with ADHD and to identify neural distinctions underlying the clinical heterogeneity of ADHD.

We performed cerebellum segmentation and parcellation on magnetic resonance images from right-handed boys, aged 6-13 years, including 22 boys with autism [16 with language impairment (ALI)], 9 boys with Specific Language Impairment (SLI), and 11 normal controls. Language-impaired groups had reversed asymmetry relative to unimpaired groups in posterior-lateral cerebellar lobule VIIIA (right side larger in unimpaired groups, left side larger in ALI and SLI), contralateral to previous findings in inferior frontal cortex language areas. Lobule VIIA Crus I was smaller in SLI than in ALI. Vermis volume, particularly anterior I-V, was decreased in language-impaired groups. Language performance test scores correlated with lobule VIIIA asymmetry and with anterior vermis volume. These findings suggest ALI and SLI subjects show abnormalities in neurodevelopment of fronto-corticocerebellar circuits that manage motor control and the processing of language, cognition, working memory, and attention.