Back to Search Start Over

Uncertainty estimation and misclassification probability for classification models based on discriminant analysis and support vector machines.

Authors :
Morais CLM
Lima KMG
Martin FL
Source :
Analytica chimica acta [Anal Chim Acta] 2019 Jul 31; Vol. 1063, pp. 40-46. Date of Electronic Publication: 2018 Sep 15.
Publication Year :
2019

Abstract

Uncertainty estimation provides a quantitative value of the predictive performance of a classification model based on its misclassification probability. Low misclassification probabilities are associated with a low degree of uncertainty, indicating high trustworthiness; while high misclassification probabilities are associated with a high degree of uncertainty, indicating a high susceptibility to generate incorrect classification. Herein, misclassification probability estimations based on uncertainty estimation by bootstrap were developed for classification models using discriminant analysis [linear discriminant analysis (LDA) and quadratic discriminant analysis (QDA)] and support vector machines (SVM). Principal component analysis (PCA) was used as variable reduction technique prior classification. Four spectral datasets were tested (1 simulated and 3 real applications) for binary and ternary classifications. Models with lower misclassification probabilities were more stable when the spectra were perturbed with white Gaussian noise, indicating better robustness. Thus, misclassification probability can be used as an additional figure of merit to assess model robustness, providing a reliable metric to evaluate the predictive performance of a classifier.<br /> (Copyright © 2018 Elsevier B.V. All rights reserved.)

Details

Language :
English
ISSN :
1873-4324
Volume :
1063
Database :
MEDLINE
Journal :
Analytica chimica acta
Publication Type :
Academic Journal
Accession number :
30967184
Full Text :
https://doi.org/10.1016/j.aca.2018.09.022