Search

Treatment decisions in patients with metastatic bone disease rely on accurate survival estimation. We developed the original PATHFx models using expensive, proprietary software and now seek to provide a more cost-effective solution. Using open-source machine learning software to create PATHFx version 2.0, we asked whether PATHFx 2.0 could be created using open-source methods and externally validated in two unique patient populations. The training set of a well-characterized, database records of 189 patients and the bnlearn package within R Version 3.5.1 (R Foundation for Statistical Computing), was used to establish a series of Bayesian belief network models designed to predict survival at 1, 3, 6, 12, 18, and 24 months. Each was externally validated in both a Scandinavian (n = 815 patients) and a Japanese (n = 261 patients) data set. Brier scores and receiver operating characteristic curves to assessed discriminatory ability. Decision curve analysis (DCA) evaluated whether models should be used clinically. DCA showed that the model should be used clinically at all time points in the Scandinavian data set. For the 1-month time point, DCA of the Japanese data set suggested to expect better outcomes assuming all patients will survive greater than 1 month. Brier scores for each curve demonstrate that the models are accurate at each time point. Statement of Clinical Significance: we successfully transitioned to PATHFx 2.0 using open-source software and externally validated it in two unique patient populations, which can be used as a cost-effective option to guide surgical decisions in patients with metastatic bone disease., (© 2020 Orthopaedic Research Society. Published by Wiley Periodicals LLC.)

Background: We recently developed a clinical decision support tool, capable of estimating the likelihood of survival at 3 and 12 months following surgery for patients with operable skeletal metastases. After making it publicly available on www.PATHFx.org , we attempted to externally validate it using independent, international data., Methods: We collected data from patients treated at 13 Italian orthopaedic oncology referral centers between 2010 and 2013, then applied to PATHFx, which generated a probability of survival at three and 12-months for each patient. We assessed accuracy using the area under the receiver-operating characteristic curve (AUC), clinical utility using Decision Curve Analysis (DCA), and compared the Italian patient data to the training set (United States) and first external validation set (Scandinavia)., Results: The Italian dataset contained 287 records with at least 12 months follow-up information. The AUCs for the three-month and 12-month estimates was 0.80 and 0.77, respectively. There were missing data, including the surgeon's estimate of survival that was missing in the majority of records. Physiologically, Italian patients were similar to patients in the training and first validation sets. However notable differences were observed in the proportion of those surviving three and 12-months, suggesting differences in referral patterns and perhaps indications for surgery., Conclusions: PATHFx was successfully validated in an Italian dataset containing missing data. This study demonstrates its broad applicability to European patients, even in centers with differing treatment philosophies from those previously studied.