Back to Search
Start Over
A novel combining classifier method based on Variational Inference
- Source :
- Pattern Recognition. 49:198-212
- Publication Year :
- 2016
- Publisher :
- Elsevier BV, 2016.
-
Abstract
- In this paper, we propose a combining classifier method based on the Bayesian inference framework. Specifically, the outputs of base classifiers (called Level1 data or meta-data) are utilized in a combiner to produce the final classification. In our ensemble system, each class in the training set induces a distribution on the Level1 data, which is modeled by a multivariate Gaussian distribution. Traditionally, the parameters of the Gaussian are estimated using a maximum likelihood approach. However, maximum likelihood estimation cannot be applied since the covariance matrix of Level1 data of each class is not full rank. Instead, we propose to estimate the multivariate Gaussian distribution of Level1 data of each class by using the Variational Inference method. Experiments conducted on eighteen UCI Machine Learning Repository datasets and a selected 10-class CLEF2009 medical imaging database demonstrated the advantage of our method compared with several well-known ensemble methods. We proposed a Variational Inference method for multivariate Gaussian distribution estimation.We proposed a novel combining classifier method by employing Variational Inference on base classifiers' outputs.The proposed method is highly competitive to many state-of-the-arts ensemble classifier methods.
- Subjects :
- Gaussian
Inference
Multivariate normal distribution
02 engineering and technology
Bayesian inference
01 natural sciences
010104 statistics & probability
symbols.namesake
Artificial Intelligence
0202 electrical engineering, electronic engineering, information engineering
0101 mathematics
Mathematics
business.industry
Pattern recognition
Quadratic classifier
Ensemble learning
ComputingMethodologies_PATTERNRECOGNITION
Signal Processing
Margin classifier
symbols
020201 artificial intelligence & image processing
Computer Vision and Pattern Recognition
Artificial intelligence
business
Classifier (UML)
Software
Subjects
Details
- ISSN :
- 00313203
- Volume :
- 49
- Database :
- OpenAIRE
- Journal :
- Pattern Recognition
- Accession number :
- edsair.doi...........1f8604b33c3e0c1c8264b4743e3cff50