Search

Results of neuroimaging datasets aggregated from multiple sites may be biased by site-specific profiles in participants' demographic and clinical characteristics, as well as MRI acquisition protocols and scanning platforms. We compared the impact of four different harmonization methods on results obtained from analyses of cortical thickness data: (1) linear mixed-effects model (LME) that models site-specific random intercepts (LME INT ), (2) LME that models both site-specific random intercepts and age-related random slopes (LME INT+SLP ), (3) ComBat, and (4) ComBat with a generalized additive model (ComBat-GAM). Our test case for comparing harmonization methods was cortical thickness data aggregated from 29 sites, which included 1,340 cases with posttraumatic stress disorder (PTSD) (6.2-81.8 years old) and 2,057 trauma-exposed controls without PTSD (6.3-85.2 years old). We found that, compared to the other data harmonization methods, data processed with ComBat-GAM was more sensitive to the detection of significant case-control differences (Χ 2 (3) = 63.704, p < 0.001) as well as case-control differences in age-related cortical thinning (Χ 2 (3) = 12.082, p = 0.007). Both ComBat and ComBat-GAM outperformed LME methods in detecting sex differences (Χ 2 (3) = 9.114, p = 0.028) in regional cortical thickness. ComBat-GAM also led to stronger estimates of age-related declines in cortical thickness (corrected p-values < 0.001), stronger estimates of case-related cortical thickness reduction (corrected p-values < 0.001), weaker estimates of age-related declines in cortical thickness in cases than controls (corrected p-values < 0.001), stronger estimates of cortical thickness reduction in females than males (corrected p-values < 0.001), and stronger estimates of cortical thickness reduction in females relative to males in cases than controls (corrected p-values < 0.001). Our results support the use of ComBat-GAM to minimize confounds and increase statistical power when harmonizing data with non-linear effects, and the use of either ComBat or ComBat-GAM for harmonizing data with linear effects., Competing Interests: Conflicts of Interest Dr. Abdallah has served as a consultant, speaker and/or on advisory boards for FSV7, Lundbeck, Psilocybin Labs, Genentech and Janssen, and editor of Chronic Stress for Sage Publications, Inc.; he has filed a patent for using mTOR inhibitors to augment the effects of antidepressants (filed on August 20, 2018). Dr. Davidson is the founder and president of, and serves on the board of directors for, the non-profit organization Healthy Minds Innovations, Inc. Dr. Jahanshad, Dr. Thompson and Dr. Ching received partial research support from Biogen, Inc. (Boston, USA) for research unrelated to the content of this manuscript. Dr. Krystal is a consultant for AbbVie, Inc., Amgen, Astellas Pharma Global Development, Inc., AstraZeneca Pharmaceuticals, Biomedisyn Corporation, Bristol-Myers Squibb, Eli Lilly and Company, Euthymics Bioscience, Inc., Neurovance, Inc., FORUM Pharmaceuticals, Janssen Research & Development, Lundbeck Research USA, Novartis Pharma AG, Otsuka America Pharmaceutical, Inc., Sage Therapeutics, Inc., Sunovion Pharmaceuticals, Inc., and Takeda Industries; is on the Scientific Advisory Board for Lohocla Research Corporation, Mnemosyne Pharmaceuticals, Inc., Naurex, Inc., and Pfizer; is a stockholder in Biohaven Pharmaceuticals; holds stock options in Mnemosyne Pharmaceuticals, Inc.; holds patents for Dopamine and Noradrenergic Reuptake Inhibitors in Treatment of Schizophrenia, US Patent No. 5,447,948 (issued September 5, 1995), and Glutamate Modulating Agents in the Treatment of Mental Disorders, U.S. Patent No. 8,778,979 (issued July 15, 2014); and filed a patent for Intranasal Administration of Ketamine to Treat Depression. U.S. Application No. 14/197,767 (filed on March 5, 2014); US application or Patent Cooperation Treaty international application No. 14/306,382 (filed on June 17, 2014); Filed a patent for using mTOR inhibitors to augment the effects of antidepressants (filed on August 20, 2018). Dr. Schmahl is a consultant for Boehringer Ingelheim International GmbH. Dr. Stein has received research grants and/or consultancy honoraria from Lundbeck and Sun. Dr. Lebois reports unpaid membership on the Scientific Committee for the International Society for the Study of Trauma and Dissociation (ISSTD) and spousal license payment for Vanderbilt IP from Acadia Pharmaceuticals unrelated to the topic of this manuscript. All other authors have no conflicts of interest to declare., (Copyright © 2022. Published by Elsevier Inc.)

A common limitation of neuroimaging studies is their small sample sizes. To overcome this hurdle, the Enhancing Neuro Imaging Genetics through Meta-Analysis (ENIGMA) Consortium combines neuroimaging data from many institutions worldwide. However, this introduces heterogeneity due to different scanning devices and sequences. ENIGMA projects commonly address this heterogeneity with random-effects meta-analysis or mixed-effects mega-analysis. Here we tested whether the batch adjustment method, ComBat, can further reduce site-related heterogeneity and thus increase statistical power. We conducted random-effects meta-analyses, mixed-effects mega-analyses and ComBat mega-analyses to compare cortical thickness, surface area and subcortical volumes between 2897 individuals with a diagnosis of schizophrenia and 3141 healthy controls from 33 sites. Specifically, we compared the imaging data between individuals with schizophrenia and healthy controls, covarying for age and sex. The use of ComBat substantially increased the statistical significance of the findings as compared to random-effects meta-analyses. The findings were more similar when comparing ComBat with mixed-effects mega-analysis, although ComBat still slightly increased the statistical significance. ComBat also showed increased statistical power when we repeated the analyses with fewer sites. Results were nearly identical when we applied the ComBat harmonization separately for cortical thickness, cortical surface area and subcortical volumes. Therefore, we recommend applying the ComBat function to attenuate potential effects of site in ENIGMA projects and other multi-site structural imaging work. We provide easy-to-use functions in R that work even if imaging data are partially missing in some brain regions, and they can be trained with one data set and then applied to another (a requirement for some analyses such as machine learning)., Competing Interests: Declaration of competing interest AB has consulting fees from Biogen and lecture fees from Lundbeck, Otsuka and Janssen. AP has served as a consultant for Boehringer Ingelheim. AS: Advisory board (DSP), Research grants (CynK, DSP, MTPC, and Ono). CA has been a consultant to or has received honoraria or grants from Acadia, Angelini, Gedeon Richter, Janssen Cilag, Lundbeck, Otsuka, Roche, Sage, Servier, Shire, Schering Plough, Sumitomo Dainippon Pharma, Sunovion and Takeda. CH is faculty member, Lundbeck Psychiatric Institute. CP is on an advisory board for Lundbeck, Australia Pty Ltd and also received honoraria for talks presented at educational meetings organized by Lundbeck. CSW is on an advisory board for Lundbeck, Australia Pty Ltd and in collaboration with Astellas Pharma Inc., Japan. DJS has received research grants or consultancy honoraria from Lundbeck and Sun. EV has received grants and served as a consultant, advisor or CME speaker for the following entities (work unrelated to the topic of this manuscript): AB-Biotics, Abbott, Allergan, Angelini, Dainippon Sumitomo Pharma, Galenica, Janssen, Lundbeck, Novartis, Otsuka, Sage, Sanofi-Aventis, and Takeda. IN has no conflicts of interest to declare. RTS has received consulting fees from Genentech and Roche. SL has received consulting fees and speaking honoraria from Roche, Novartis, Biogen and Merck., (Copyright © 2020 The Author(s). Published by Elsevier Inc. All rights reserved.)