Back to Search Start Over

Uncertainty quantification in extreme learning machine: Analytical developments, variance estimates and confidence intervals.

Authors :
Guignard, Fabian
Amato, Federico
Kanevski, Mikhail
Source :
Neurocomputing. Oct2021, Vol. 456, p436-449. 14p.
Publication Year :
2021

Abstract

• Analytical developments support the understanding of ELM variability. • A special attention is paid to the impact of the input weight randomness. • Variance estimates for homoskedastic, heteroskedastic, regularized cases are given. • The possibility of constructing accurate confidence intervals is discussed. • A new Python library allows the computation of the proposed estimates. Uncertainty quantification is crucial to assess prediction quality of a machine learning model. In the case of Extreme Learning Machines (ELM), most methods proposed in the literature make strong assumptions on the data, ignore the randomness of input weights or neglect the bias contribution in confidence interval estimations. This paper presents novel estimations that overcome these constraints and improve the understanding of ELM variability. Analytical derivations are provided under general assumptions, supporting the identification and the interpretation of the contribution of different variability sources. Under both homoskedasticity and heteroskedasticity, several variance estimates are proposed, investigated, and numerically tested, showing their effectiveness in replicating the expected variance behaviours. Finally, the feasibility of confidence intervals estimation is discussed by adopting a critical approach, hence raising the awareness of ELM users concerning some of their pitfalls. The paper is accompanied with a scikit-learn compatible Python library enabling efficient computation of all estimates discussed herein. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09252312
Volume :
456
Database :
Academic Search Index
Journal :
Neurocomputing
Publication Type :
Academic Journal
Accession number :
151684542
Full Text :
https://doi.org/10.1016/j.neucom.2021.04.027