Search

Background: The reproducibility crisis in AI research remains a significant concern. While code sharing has been acknowledged as a step toward addressing this issue, our focus extends beyond this paradigm. In this work, we explore "federated testing" as an avenue for advancing reproducible AI research and development especially in medical imaging. Unlike federated learning, where a model is developed and refined on data from different centers, federated testing involves models developed by one team being deployed and evaluated by others, addressing reproducibility across various implementations., Methods: Our study follows an exploratory design aimed at systematically evaluating the sources of discrepancies in shared model execution for medical imaging and outputs on the same input data, independent of generalizability analysis. We distributed the same model code to multiple independent centers, monitoring execution in different runtime environments while considering various real-world scenarios for pre- and post-processing steps. We analyzed deployment infrastructure by comparing the impact of different computational resources (GPU vs. CPU) on model performance. To assess federated testing in AI models for medical imaging, we performed a comparative evaluation across different centers, each with distinct pre- and post-processing steps and deployment environments, specifically targeting AI-driven positron emission tomography (PET) imaging segmentation. More specifically, we studied federated testing for an AI-based model for surrogate total metabolic tumor volume (sTMTV) segmentation in PET imaging: the AI algorithm, trained on maximum intensity projection (MIP) data, segments lymphoma regions and estimates sTMTV., Results: Our study reveals that relying solely on open-source code sharing does not guarantee reproducible results due to variations in code execution, runtime environments, and incomplete input specifications. Deploying the segmentation model on local and virtual GPUs compared to using Docker containers showed no effect on reproducibility. However, significant sources of variability were found in data preparation and pre-/post- processing techniques for PET imaging. These findings underscore the limitations of code sharing alone in achieving consistent and accurate results in federated testing., Conclusion: Achieving consistently precise results in federated testing requires more than just sharing models through open-source code. Comprehensive pipeline sharing, including pre- and post-processing steps, is essential. Cloud-based platforms that automate these processes can streamline AI model testing across diverse locations. Standardizing protocols and sharing complete pipelines can significantly enhance the robustness and reproducibility of AI models., (Copyright © 2024. Published by Elsevier Inc.)

Several genetic pathogenic variants increase the risk of Parkinson's disease (PD) with pathogenic variants in the leucine-rich repeat kinase 2 (LRRK2) gene being among the most common. A joint pattern analysis based on multi-set canonical correlation analysis (MCCA) was utilized to extract PD and LRRK2 pathogenic variant-specific spatial patterns in relation to healthy controls (HCs) from multi-tracer Positron Emission Tomography (PET) data. Spatial patterns were extracted for individual subject cohorts, as well as for pooled subject cohorts, to explore whether complementary spatial patterns of dopaminergic denervation are different in the asymptomatic and symptomatic stages of PD. The MCCA results are also compared to the traditional univariate analysis, which serves as a reference. We identified PD-induced spatial distribution alterations common to DAT and VMAT2 in both asymptomatic LRRK2 pathogenic variant carriers and PD subjects. The inclusion of HCs in the analysis demonstrated that the dominant common PD-induced pattern is related to an overall dopaminergic terminal density denervation, followed by asymmetry and rostro-caudal gradient with deficits in the less affected side still being the best marker of disease progression. The analysis was able to capture a trend towards PD-related patterns in the LRRK2 pathogenic variant carrier cohort with increasing age in line with the known increased risk of this patient cohort to develop PD as they age. The advantage of this method thus resides in its ability to identify not only regional differences in tracer binding between groups, but also common disease-related alterations in the spatial distribution patterns of tracer binding, thus potentially capturing more complex aspects of disease induced alterations., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier Inc. All rights reserved.)

Alterations in different aspects of dopamine processing may exhibit different progressive behaviours throughout the course of Parkinson's disease. We used a novel data-driven multivariate approach to quantify and compare spatiotemporal patterns related to different aspects of dopamine processing from cross-sectional Parkinson's subjects obtained with: 1) 69 [ 11 C]±dihydrotetrabenazine (DTBZ) scans, most closely related to dopaminergic denervation; 2) 73 [ 11 C]d-threo-methylphenidate (MP) scans, marker of dopamine transporter density; 3) 50 6-[ 18 F]fluoro-l-DOPA (FD) scans, marker of dopamine synthesis and storage. The anterior-posterior gradient in the putamen was identified as the most salient feature associated with disease progression, however the temporal progression of the spatial gradient was different for the three tracers. The expression of the anterior-posterior gradient was the highest for FD at disease onset compared to that of DTBZ and MP (P = 0.018 and P = 0.047 respectively), but decreased faster (P = 0.006) compared to that of DTBZ. The gradient expression for MP was initially similar but decreased faster (P = 0.015) compared to that for DTBZ. These results reflected unique temporal behaviours of regulatory mechanisms related to dopamine synthesis (FD) and reuptake (MP). While the relative early disease upregulation of dopamine synthesis in the anterior putamen prevalent likely extends to approximately 10 years after symptom onset, the presumed downregulation of dopamine transporter density may play a compensatory role in the prodromal/earliest disease stages only., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 The Authors. Published by Elsevier Inc. All rights reserved.)

Most neurodegenerative disorders are characterized by progressive loss of neurons throughout the course of disease in the form of specific spatio-temporal patterns. To capture and quantify these coherent patterns across both space and time, traditionally one would either fit a pre-defined model with spatial and temporal parameters or apply analysis in the spatial and temporal domains separately. In this work, we introduce and validate the use of dynamic mode decomposition (DMD), a data-driven multivariate approach, to extract coupled spatio-temporal patterns simultaneously. We apply the method to examine progressive dopaminergic degeneration in 41 patients with Parkinson's disease (PD) using [ 11 C](±)dihydrotetrabenazine (DTBZ) Positron Emission Tomography (PET). DMD decomposed the progressive dopaminergic changes in the putamen into two orthogonal temporal progression curves associated with distinct spatial patterns: 1) an anterior-posterior gradient, the expression of which decreased gradually with disease progression with a higher initial expression in the less affected side; 2) a dorsal-ventral gradient in the less affected side, which was present in early disease stage only. In the caudate, we found a head-tail gradient analogous to the anterior-posterior gradient seen in the putamen; as in the putamen, the expression of this gradient decreased gradually with disease progression with higher expression in the less affected side. Our results with DTBZ PET data show the applicability and relevance of the proposed method for extracting spatio-temporal patterns of neurotransmitter changes due to neurodegeneration. The method is able to decompose known PD-induced dopaminergic denervation into orthogonal (and thus loosely independent) temporal curves, which may be able to reflect and separate either different mechanisms underlying disease progression and disease initiation, or differential involvement of striatal sub-regions at different disease stages, in a completely data driven way. It is expected that this method can be easily extended to other PET tracers and neurodegenerative disorders and may help to elucidate disease mechanisms in more details compared to traditional approaches., Competing Interests: Declaration of Competing Interest The authors do not have any conflict of interest to report., (Crown Copyright © 2020. Published by Elsevier Inc. All rights reserved.)

Background: Given the increasing recognition of the significance of non-motor symptoms in Parkinson's disease, we investigate the optimal use of machine learning methods for the prediction of the Montreal Cognitive Assessment (MoCA) score at year 4 from longitudinal data obtained at years 0 and 1., Methods: We selected n = 184 PD subjects from the Parkinson's Progressive Marker Initiative (PPMI) database (93 features). A range of robust predictor algorithms (accompanied with automated machine learning hyperparameter tuning) and feature subset selector algorithms (FSSAs) were selected. We utilized 65%, 5% and 30% of patients in each arrangement for training, training validation and final testing respectively (10 randomized arrangements). For further testing, we enrolled 308 additional patients., Results: First, we employed 10 predictor algorithms, provided with all 93 features; an error of 1.83 ± 0.13 was obtained by LASSOLAR (Least Absolute Shrinkage and Selection Operator - Least Angle Regression). Subsequently, we used feature subset selection followed by predictor algorithms. GA (Genetic Algorithm) selected 18 features; subsequently LOLIMOT (Local Linear Model Trees) reached an error of 1.70 ± 0.10. DE (Differential evolution) also selected 18 features and coupled with Thiel-Sen regression arrived at a similar performance. NSGAII (Non-dominated sorting genetic algorithm) yielded the best performance: it selected six vital features, which combined with LOLIMOT reached an error of 1.68 ± 0.12. Finally, using this last approach on independent test data, we reached an error of 1.65., Conclusion: By employing appropriate optimization tools (including automated hyperparameter tuning), it is possible to improve prediction of cognitive outcome. Overall, we conclude that optimal utilization of FSSAs and predictor algorithms can produce very good prediction of cognitive outcome in PD patients., (Copyright © 2019 Elsevier Ltd. All rights reserved.)

Dopamine transporter (DAT) SPECT imaging is increasingly utilized for diagnostic purposes in suspected Parkinsonian syndromes. We performed a cross-sectional study to investigate whether assessment of texture in DAT SPECT radiotracer uptake enables enhanced correlations with severity of motor and cognitive symptoms in Parkinson's disease (PD), with the long-term goal of enabling clinical utility of DAT SPECT imaging, beyond standard diagnostic tasks, to tracking of progression in PD. Quantitative analysis in routine DAT SPECT imaging, if performed at all, has been restricted to assessment of mean regional uptake. We applied a framework wherein textural features were extracted from the images. Notably, the framework did not require registration to a common template, and worked in the subject-native space. Image analysis included registration of SPECT images onto corresponding MRI images, automatic region-of-interest (ROI) extraction on the MRI images, followed by computation of Haralick texture features. We analyzed 141 subjects from the Parkinson's Progressive Marker Initiative (PPMI) database, including 85 PD and 56 healthy controls (HC) (baseline scans with accompanying 3 T MRI images). We performed univariate and multivariate regression analyses between the quantitative metrics and different clinical measures, namely (i) the UPDRS (part III - motor) score, disease duration as measured from (ii) time of diagnosis (DD-diag.) and (iii) time of appearance of symptoms (DD-sympt.), as well as (iv) the Montreal Cognitive Assessment (MoCA) score. For conventional mean uptake analysis in the putamen, we showed significant correlations with clinical measures only when both HC and PD were included (Pearson correlation r  = - 0.74, p-value < 0.001). However, this was not significant when applied to PD subjects only ( r  = - 0.19, p-value = 0.084), and no such correlations were observed in the caudate. By contrast, for the PD subjects, significant correlations were observed in the caudate when including texture metrics, with (i) UPDRS (p-values < 0.01), (ii) DD-diag. (p-values < 0.001), (iii) DD-sympt (p-values < 0.05), and (iv) MoCA (p-values < 0.01), while no correlations were observed for conventional analysis (p-values = 0.94, 0.34, 0.88 and 0.96, respectively). Our results demonstrated the ability to capture valuable information using advanced texture metrics from striatal DAT SPECT, enabling significant correlations of striatal DAT binding with clinical, motor and cognitive outcomes, and suggesting that textural features hold potential as biomarkers of PD severity and progression.