1. Re-visiting Reservoir Computing architectures optimized by Evolutionary Algorithms
- Author
-
Basterrech, Sebastián and Sharma, Tarun Kumar
- Subjects
Computer Science - Neural and Evolutionary Computing ,Computer Science - Computer Vision and Pattern Recognition ,Computer Science - Machine Learning - Abstract
For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network topology, optimizing global parameters, and selecting features. Here, we provide a systematic brief survey about applications of the EAs on the specific domain of the recurrent NNs named Reservoir Computing (RC). At the beginning of the 2000s, the RC paradigm appeared as a good option for employing recurrent NNs without dealing with the inconveniences of the training algorithms. RC models use a nonlinear dynamic system, with fixed recurrent neural network named the \textit{reservoir}, and learning process is restricted to adjusting a linear parametric function. %so the performance of learning is fast and precise. However, an RC model has several hyper-parameters, therefore EAs are helpful tools to figure out optimal RC architectures. We provide an overview of the results on the area, discuss novel advances, and we present our vision regarding the new trends and still open questions., Comment: Accepted manuscript to the 14th World Congress on Nature and Biologically Inspired Computing (NaBIC), Seattle, WA, United States, December 14-16, 2022. A revised manuscript will be published in the conference proceedings by Springer in the Lecture Notes in Networks and Systems
- Published
- 2022