Back to Search Start Over

An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks.

Authors :
Huang GB
Saratchandran P
Sundararajan N
Source :
IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society [IEEE Trans Syst Man Cybern B Cybern] 2004 Dec; Vol. 34 (6), pp. 2284-92.
Publication Year :
2004

Abstract

This paper presents a simple sequential growing and pruning algorithm for radial basis function (RBF) networks. The algorithm referred to as growing and pruning (GAP)-RBF uses the concept of "Significance" of a neuron and links it to the learning accuracy. "Significance" of a neuron is defined as its contribution to the network output averaged over all the input data received so far. Using a piecewise-linear approximation for the Gaussian function, a simple and efficient way of computing this significance has been derived for uniformly distributed input data. In the GAP-RBF algorithm, the growing and pruning are based on the significance of the "nearest" neuron. In this paper, the performance of the GAP-RBF learning algorithm is compared with other well-known sequential learning algorithms like RAN, RANEKF, and MRAN on an artificial problem with uniform input distribution and three real-world nonuniform, higher dimensional benchmark problems. The results indicate that the GAP-RBF algorithm can provide comparable generalization performance with a considerably reduced network size and training time.

Details

Language :
English
ISSN :
1083-4419
Volume :
34
Issue :
6
Database :
MEDLINE
Journal :
IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society
Publication Type :
Academic Journal
Accession number :
15619929
Full Text :
https://doi.org/10.1109/tsmcb.2004.834428