151. Regularization networks: fast weight calculation via Kalman filtering
- Author
-
Giancarlo Ferrari-Trecate and G. De Nicolao
- Subjects
Mathematical optimization ,Computational complexity theory ,Computer Networks and Communications ,Computation ,Estimator ,General Medicine ,Spectral theorem ,Kalman filter ,Regularization (mathematics) ,Computer Science Applications ,Smoothing spline ,Hypersurface ,Artificial Intelligence ,Algorithm ,Software ,Mathematics - Abstract
Regularization networks are nonparametric estimators obtained from the application of Tychonov regularization or Bayes estimation to the hypersurface reconstruction problem. Their main drawback back is that the computation of the weights scales as O(n/sup 3/) where n is the number of data. In this paper, we show that for a class of monodimensional problems, the complexity can be reduced to O(n) by a suitable algorithm based on spectral factorization and Kalman filtering. Moreover, the procedure applies also to smoothing splines.
- Published
- 2008