Search

Importance: Determining the association of contrast volume during percutaneous coronary intervention (PCI) with the risk of acute kidney injury (AKI) is important for optimizing PCI safety., Objective: To quantify how the risk of AKI is associated with contrast volume, accounting for the possibility of nonlinearity and heterogeneity among different baseline risks., Design, Setting, and Participants: This prognostic study used data from the American College of Cardiology National Cardiovascular Data Registry CathPCI Registry for 1694 US hospitals. Derivation analysis included 2 076 694 individuals who underwent PCI from July 1, 2011, to June 30, 2015. Validation analysis included 961 863 individuals who underwent PCI from July 1, 2015, to March 31, 2017. Data analysis took place from July 2018 to May 2019., Exposure: Contrast volume during PCI., Main Outcomes and Measures: Acute kidney injury was defined using 3 thresholds for preprocedure to postprocedure creatinine level increase (ie, ≥0.3 mg/dL, ≥0.5 mg/dL, and ≥1.0 mg/dL). A model quantifying the association of contrast volume with AKI was developed, and the existence of nonlinearity and heterogeneity were examined by likelihood ratio tests. The model was derived in the training set (a random 50% of the derivation cohort), and performance was evaluated in the test set (the remaining 50% of the derivation cohort) and an independent validation set by area under the receiver operating characteristic curve (AUC) and calibration slope of observed vs predicted risks., Results: The 2 076 694 patients in the derivation set had a mean (SD) age of 65.1 (12.1) years, and 662 525 (31.9%) were women; 133 306 (6.4%) had creatinine level increases of at least 0.3 mg/dL, 66 626 (3.2%) had creatinine level increases of at least 0.5 mg/dL, and 28 378 (1.4%) had creatinine level increases of at least 1.0 mg/dL. In the validation set of 961 843 patients (mean [SD] age, 65.7 [12.1] years; 305 577 [31.8%] women), these rates were 62 913 (6.5%), 34 229 (3.6%), and 15 555 (1.6%), respectively. The association of contrast volume and AKI risk was nonlinear (χ226 = 1436.2; P < .001) and varied by preprocedural risk (χ220 = 105.6; P < .001). In the test set, the model yielded an AUC of 0.777 (95% CI, 0.775-0.779) for predicting risk of a creatinine level increase of at least 0.3 mg/dL, 0.839 (95% CI, 0.837-0.841) for predicting risk of a creatinine level increase of at least 0.5 mg/dL, and 0.870 (95% CI, 0.867-0.873) for predicting risk of a creatinine level increase of at least 1.0 mg/dL; it achieved a calibration slope of 0.998 (95% CI, 0.989-1.007), 0.999 (95% CI, 0.989-1.008), and 0.986 (95% CI, 0.973-0.998), respectively, for the AKI severity levels. The model had similar performance in the validation set (creatinine level increase of ≥0.3 mg/dL: AUC, 0.794; 95% CI, 0.792-0.795; calibration slope, 1.039; 95% CI, 1.030-1.047; creatinine level increase of ≥0.5 mg/dL: AUC, 0.845; 95% CI, 0.843-0.848; calibration slope, 1.063; 95% CI, 1.054-1.074; creatinine level increase of ≥1.0 mg/dL: AUC, 0.872; 95% CI, 0.869-0.875; calibration slope, 1.103; 95% CI, 1.089-1.117)., Conclusions and Relevance: The association of contrast volume with AKI risk is complex, varies by baseline risk, and can be predicted by a model. Future research to evaluate the effect of the model on AKI is needed.

Background: The current acute kidney injury (AKI) risk prediction model for patients undergoing percutaneous coronary intervention (PCI) from the American College of Cardiology (ACC) National Cardiovascular Data Registry (NCDR) employed regression techniques. This study aimed to evaluate whether models using machine learning techniques could significantly improve AKI risk prediction after PCI., Methods and Findings: We used the same cohort and candidate variables used to develop the current NCDR CathPCI Registry AKI model, including 947,091 patients who underwent PCI procedures between June 1, 2009, and June 30, 2011. The mean age of these patients was 64.8 years, and 32.8% were women, with a total of 69,826 (7.4%) AKI events. We replicated the current AKI model as the baseline model and compared it with a series of new models. Temporal validation was performed using data from 970,869 patients undergoing PCIs between July 1, 2016, and March 31, 2017, with a mean age of 65.7 years; 31.9% were women, and 72,954 (7.5%) had AKI events. Each model was derived by implementing one of two strategies for preprocessing candidate variables (preselecting and transforming candidate variables or using all candidate variables in their original forms), one of three variable-selection methods (stepwise backward selection, lasso regularization, or permutation-based selection), and one of two methods to model the relationship between variables and outcome (logistic regression or gradient descent boosting). The cohort was divided into different training (70%) and test (30%) sets using 100 different random splits, and the performance of the models was evaluated internally in the test sets. The best model, according to the internal evaluation, was derived by using all available candidate variables in their original form, permutation-based variable selection, and gradient descent boosting. Compared with the baseline model that uses 11 variables, the best model used 13 variables and achieved a significantly better area under the receiver operating characteristic curve (AUC) of 0.752 (95% confidence interval [CI] 0.749-0.754) versus 0.711 (95% CI 0.708-0.714), a significantly better Brier score of 0.0617 (95% CI 0.0615-0.0618) versus 0.0636 (95% CI 0.0634-0.0638), and a better calibration slope of observed versus predicted rate of 1.008 (95% CI 0.988-1.028) versus 1.036 (95% CI 1.015-1.056). The best model also had a significantly wider predictive range (25.3% versus 21.6%, p < 0.001) and was more accurate in stratifying AKI risk for patients. Evaluated on a more contemporary CathPCI cohort (July 1, 2015-March 31, 2017), the best model consistently achieved significantly better performance than the baseline model in AUC (0.785 versus 0.753), Brier score (0.0610 versus 0.0627), calibration slope (1.003 versus 1.062), and predictive range (29.4% versus 26.2%). The current study does not address implementation for risk calculation at the point of care, and potential challenges include the availability and accessibility of the predictors., Conclusions: Machine learning techniques and data-driven approaches resulted in improved prediction of AKI risk after PCI. The results support the potential of these techniques for improving risk prediction models and identification of patients who may benefit from risk-mitigation strategies., Competing Interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: SSD is supported by the Department of Veterans Affairs. WLS is a consultant for Hugo, a personal health information platform. CIM is a consultant for Cook, Bard, Medtronic, Abbott and Cardinal Health. FPW is supported by the National Science Foundation grant R01DK113191. JSR is the Chief Innovation Officer for the American College of Cardiology. HMK is a recipient of research agreements from Medtronic and from Johnson & Johnson (Janssen), through Yale University, to develop methods of clinical trial data sharing; was the recipient of a grant from the Food and Drug Administration and Medtronic to develop methods for postmarket surveillance of medical devices; works under contract with the Centers for Medicare and Medicaid Services to develop and maintain performance measures; chairs a cardiac scientific advisory board for UnitedHealth; is a member of the Advisory Board for Element Science and the Physician Advisory Board for Aetna; is a participant/participant representative of the IBM Watson Health Life Sciences Board; and is the founder of Hugo, a personal health information platform. JAS is supported by grants from Gilead, Genentech, Lilly, Amorcyte, and EvaHeart and has a patent for the Seattle Angina Questionnaire with royalties paid. He also owns the copyright to the Seattle Angina Questionnaire. He is the PI of an Analytic Center for the American College of Cardiology Foundation and has an equity interest in Health Outcomes Sciences. FAM has a contract (through his primary institution) for his role as Chief Science Officer of the NCDR. BJM is an associate editor for PLOS ONE, which is involved in this special issue. He has a relationship with the American College of Cardiology in selecting and pursuing innovative research based upon their registry data (unrelated to this paper). He has a pending patent application for an EHR-based prediction tool in Yale New Haven Health, as well as two funded studies, one by the DoD-Advanced Research Projects Agency and one with the NSF to support student travel to conferences in the body sensor networks field. American College of Cardiology may incorporate this work, or future iterations, into its registry. No other organisation named above has a competing interest in relation to this work. The other authors report no potential competing interests.