Back to Search Start Over

Why do we observe misclassification errors smaller than the Bayes error?

Authors :
Bani K. Mallick
Raymond J. Carroll
Wenjiang J. Fu
Source :
Journal of Statistical Computation and Simulation. 79:717-722
Publication Year :
2009
Publisher :
Informa UK Limited, 2009.

Abstract

In simulation studies for discriminant analysis, misclassification errors are often computed using the Monte Carlo method, by testing a classifier on large samples generated from known populations. Although large samples are expected to behave closely to the underlying distributions, they may not do so in a small interval or region, and thus may lead to unexpected results. We demonstrate with an example that the LDA misclassification error computed via the Monte Carlo method may often be smaller than the Bayes error. We give a rigorous explanation and recommend a method to properly compute misclassification errors.

Details

ISSN :
15635163 and 00949655
Volume :
79
Database :
OpenAIRE
Journal :
Journal of Statistical Computation and Simulation
Accession number :
edsair.doi...........abff41d5b131a5e80d05bf8afc8d599f
Full Text :
https://doi.org/10.1080/00949650801905221