Back to Search Start Over

A framework for understanding label leakage in machine learning for health care.

Authors :
Davis, Sharon E
Matheny, Michael E
Balu, Suresh
Sendak, Mark P
Source :
Journal of the American Medical Informatics Association; Jan2024, Vol. 31 Issue 1, p274-280, 7p
Publication Year :
2024

Abstract

Introduction The pitfalls of label leakage, contamination of model input features with outcome information, are well established. Unfortunately, avoiding label leakage in clinical prediction models requires more nuance than the common advice of applying "no time machine rule." Framework We provide a framework for contemplating whether and when model features pose leakage concerns by considering the cadence, perspective, and applicability of predictions. To ground these concepts, we use real-world clinical models to highlight examples of appropriate and inappropriate label leakage in practice. Recommendations Finally, we provide recommendations to support clinical and technical stakeholders as they evaluate the leakage tradeoffs associated with model design, development, and implementation decisions. By providing common language and dimensions to consider when designing models, we hope the clinical prediction community will be better prepared to develop statistically valid and clinically useful machine learning models. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10675027
Volume :
31
Issue :
1
Database :
Complementary Index
Journal :
Journal of the American Medical Informatics Association
Publication Type :
Academic Journal
Accession number :
174444554
Full Text :
https://doi.org/10.1093/jamia/ocad178