Back to Search
Start Over
Minimum Description Length Criterion for Modeling of Chaotic Attractors With Multilayer Perceptron Networks.
- Source :
- IEEE Transactions on Circuits & Systems. Part I: Regular Papers; Mar2006, Vol. 53 Issue 3, p722-732, 11p, 9 Graphs
- Publication Year :
- 2006
-
Abstract
- Overfitting has long been recognized as a problem endemic to models with a large number of parameters. The usual method of avoiding this problem in neural networks is to avoid fitting the data too precisely, and this technique cannot determine the exact model size directly. In this paper, we describe an alternative, information theoretic criterion to determine the number of neurons in the optimal model. When applied to the time series prediction problem we find that models which minimize the description length (DL) of the data, both generalize well and accurately capture the underlying dynamics. We illustrate our method with several computational and experimental examples. [ABSTRACT FROM AUTHOR]
Details
- Language :
- English
- ISSN :
- 15498328
- Volume :
- 53
- Issue :
- 3
- Database :
- Complementary Index
- Journal :
- IEEE Transactions on Circuits & Systems. Part I: Regular Papers
- Publication Type :
- Periodical
- Accession number :
- 20332516
- Full Text :
- https://doi.org/10.1109/TCSI.2005.858321