1. A New Type of Hybrid Learning Algorithm for Three-Layered Feed-Forward Neural Networks
- Author
-
Peng Liang He, Yun Jun Yu, Sui Peng, and Zhi Chuan Wu
- Subjects
Mathematical optimization ,Wake-sleep algorithm ,Artificial neural network ,Computer science ,Population-based incremental learning ,General Engineering ,Parallel algorithm ,Out-of-kilter algorithm ,Rprop ,Least squares ,Hybrid algorithm ,Linear function ,Nonlinear programming ,Ramer–Douglas–Peucker algorithm ,Difference-map algorithm ,FSA-Red Algorithm - Abstract
The problem of local minimum cannot be avoided when it comes to nonlinear optimization in the learning algorithm of neural network parameters, and the larger the optimization space is, the more obvious the problem becomes. This paper proposes a new type of hybrid learning algorithm for three-layered feed-forward neural networks. This algorithm is based on three-layered feed-forward neural networks with output layer function, namely linear function, combining a quasi Newton algorithm with adaptive decoupled step and momentum (QNADSM) and iterative least square method to export. Simulation proves that this hybrid algorithm has strong self-adaptive capability, small calculation amount and fast convergence speed. It is an effective engineer practical algorithm. more...
- Published
- 2014
- Full Text
- View/download PDF