1. Supervised outlier detection for classification and regression
- Author
-
Fernández Pascual, Ángela, Bella, Juan, Dorronsoro Ibero, José Ramón, UAM. Departamento de Ingeniería Informática, and Aprendizaje Automático (ING EPS-001)
- Subjects
Informática ,Cognitive Neuroscience ,Classification ,Regression ,Computer Science Applications ,Histogram based outlier detection ,Optimal hyperparameter selection ,Artificial Intelligence ,Isolation forests ,Outlier detection ,Local outlier factor ,Minimum covariance determinant ,Supervised learning - Abstract
Outlier detection, i.e., the task of detecting points that are markedly different from the data sample, is an important challenge in machine learning. When a model is built, these special points can skew the model training and result in less accurate predictions. Due to this fact, it is important to identify and remove them before building any supervised model and this is often the first step when dealing with a machine learning problem. Nowadays, there exists a very large number of outlier detector algorithms that provide good results, but their main drawbacks are their unsupervised nature together with the hyperparameters that must be properly set for obtaining good performance. In this work, a new supervised outlier estimator is proposed. This is done by pipelining an outlier detector with a following a supervised model, in such a way that the targets of the later supervise how all the hyperparameters involved in the outlier detector are optimally selected. This pipeline-based approach makes it very easy to combine different outlier detectors with different classifiers and regressors. In the experiments done, nine relevant outlier detectors have been combined with three regressors over eight regression problems as well as with two classifiers over another eight binary and multi-class classification problems. The usefulness of the proposal as an objective and automatic way to optimally determine detector hyperparameters has been proven and the effectiveness of the nine outlier detectors has also been analyzed and compared, The authors acknowledge financial support from the European Regional Development Fund and the Spanish State Research Agency of the Ministry of Economy, Industry, and Competitiveness under the projects TIN2016-76406-P (AEI/FEDER, UE) and PID2019-106827GB-I00. They also thank the UAM–ADIC Chair for Data Science and Machine Learning and gratefully acknowledge the use of the facilities of Centro de Computación Científica (CCC) at UAM
- Published
- 2022
- Full Text
- View/download PDF