1. Two-stage Learning-to-Defer for Multi-Task Learning
- Author
-
Montreuil, Yannis, Yeo, Shu Heng, Carlier, Axel, Ng, Lai Xing, and Ooi, Wei Tsang
- Subjects
Statistics - Machine Learning ,Computer Science - Human-Computer Interaction ,Computer Science - Machine Learning - Abstract
The Learning-to-Defer approach has been explored for classification and, more recently, regression tasks separately. Many contemporary learning tasks, however, involves both classification and regression components. In this paper, we introduce a Learning-to-Defer approach for multi-task learning that encompasses both classification and regression tasks. Our two-stage approach utilizes a rejector that defers decisions to the most accurate agent among a pre-trained joint classifier-regressor models and one or more external experts. We show that our surrogate loss is $(\mathcal{H}, \mathcal{F}, \mathcal{R})$ and Bayes--consistent, ensuring an effective approximation of the optimal solution. Additionally, we derive learning bounds that demonstrate the benefits of employing multiple confident experts along a rich model in a two-stage learning framework. Empirical experiments conducted on electronic health record analysis tasks underscore the performance enhancements achieved through our method., Comment: 32 pages, 17 main paper
- Published
- 2024