Search

To identify neuroimaging biomarkers of alcohol dependence (AD) from structural magnetic resonance imaging, it may be useful to develop classification models that are explicitly generalizable to unseen sites and populations. This problem was explored in a mega-analysis of previously published datasets from 2,034 AD and comparison participants spanning 27 sites curated by the ENIGMA Addiction Working Group. Data were grouped into a training set used for internal validation including 1,652 participants (692 AD, 24 sites), and a test set used for external validation with 382 participants (146 AD, 3 sites). An exploratory data analysis was first conducted, followed by an evolutionary search based feature selection to site generalizable and high performing subsets of brain measurements. Exploratory data analysis revealed that inclusion of case- and control-only sites led to the inadvertent learning of site-effects. Cross validation methods that do not properly account for site can drastically overestimate results. Evolutionary-based feature selection leveraging leave-one-site-out cross-validation, to combat unintentional learning, identified cortical thickness in the left superior frontal gyrus and right lateral orbitofrontal cortex, cortical surface area in the right transverse temporal gyrus, and left putamen volume as final features. Ridge regression restricted to these features yielded a test-set area under the receiver operating characteristic curve of 0.768. These findings evaluate strategies for handling multi-site data with varied underlying class distributions and identify potential biomarkers for individuals with current AD.

The problem of poor reproducibility of scientific findings has received much attention over recent years, in a variety of fields including psychology and neuroscience. The problem has been partly attributed to publication bias and unwanted practices such as p-hacking. Low statistical power in individual studies is also understood to be an important factor. In a recent multisite collaborative study, we mapped brain anatomical left-right asymmetries for regional measures of surface area and cortical thickness, in 99 MRI datasets from around the world, for a total of over 17,000 participants. In the present study, we revisited these hemispheric effects from the perspective of reproducibility. Within each dataset, we considered that an effect had been reproduced when it matched the meta-analytic effect from the 98 other datasets, in terms of effect direction and significance threshold. In this sense, the results within each dataset were viewed as coming from separate studies in an "ideal publishing environment," that is, free from selective reporting and p hacking. We found an average reproducibility rate of 63.2% (SD = 22.9%, min = 22.2%, max = 97.0%). As expected, reproducibility was higher for larger effects and in larger datasets. Reproducibility was not obviously related to the age of participants, scanner field strength, FreeSurfer software version, cortical regional measurement reliability, or regional size. These findings constitute an empirical illustration of reproducibility in the absence of publication bias or p hacking, when assessing realistic biological effects in heterogeneous neuroscience data, and given typically-used sample sizes.

Background: The nitric oxide synthasase-1 gene ( NOS1) has been implicated in mental disorders including schizophrenia and variation in cognition. The NOS1 variant rs6490121 identified in a genome wide association study of schizophrenia has recently been associated with variation in general intelligence and working memory in both patients and healthy participants. Whether this variant is also associated with variation in early sensory processing remains unclear. Methods: We investigated differences in the P1 visual evoked potential in a high density EEG study of 54 healthy participants. Given both NOS1's association with cognition and recent evidence that cognitive performance and P1 response are correlated, we investigated whether NOS1's effect on P1 response was independent of its effects on cognition using CANTAB's spatial working memory (SWM) task. Results: We found that carriers of the previously identified risk 'G' allele showed significantly lower P1 responses than non-carriers. We also found that while P1 response and SWM performance were correlated, NOS1 continued to explain a significant proportion of variation in P1 response even when its effects on cognition were accounted for. Conclusion: The schizophrenia implicated NOS1 variants rs6490121 influences visual sensory processing as measured by the P1 response, either as part of the gene's pleiotropic effects on multiple aspects of brain function, or because of a primary influence on sensory processing that mediates the effects already seen in higher cognitive processes. Hum Brain Mapp, 2011. © 2011 Wiley-Liss, Inc. [ABSTRACT FROM AUTHOR]