1. Veri bağlanımı için yüksek verimli yinelemeli sinir ağı yapısı
- Author
-
Tolga Ergen and Emir Ceyani
- Subjects
Gradient descent ,business.industry ,Stochastic process ,Computer science ,Long short term memory network ,Matrix factorization ,Ef-operator ,020206 networking & telecommunications ,02 engineering and technology ,Machine learning ,computer.software_genre ,Matrix decomposition ,Nonlinear system ,Exponentiated gradient ,Stochastic gradient descent ,Recurrent neural network ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Artificial intelligence ,Architecture ,business ,computer ,Efficient energy use - Abstract
Date of Conference: 2-5 May 2018 In this paper, we study online nonlinear data regression and propose a highly efficient long short term memory (LSTM) network based architecture. Here, we also introduce on-line training algorithms to learn the parameters of the introduced architecture. We first propose an LSTM based architecture for data regression. To diminish the complexity of this architecture, we use an energy efficient operator (ef-operator) instead of the multiplication operation. We then factorize the matrices of the LSTM network to reduce the total number of parameters to be learned. In order to train the parameters of this structure, we introduce online learning methods based on the exponentiated gradient (EG) and stochastic gradient descent (SGD) algorithms. Experimental results demonstrate considerable performance and efficiency improvements provided by the introduced architecture.
- Published
- 2018