Search

Artificial Neural Networks (ANNs) have amassed unprecedented success in information processing ranging from image recognition to time series prediction. The success can largely be attributed to the availability of large datasets for training and the increased complexity of the models. Unfortunately, for some applications only a limited amount of samples is available for training. Fewer training samples increases the risk of over-fitting and poor generalization especially in high complexity models. Moreover, complex models with a large number of trainable parameters require more energy to train and optimize compared to simpler ones. In this paper, to the best of our knowledge, we propose the first use of ANNs for Early Stage Alzheimer Disease classification (ES-AD) from the handwriting (HW). We propose using a framework for building Recurrent Neural Networks (RNNs) known as Reservoir Computing (RC), both numerically and experimentally, that simplifies training by optimizing the output layer only. We also propose the Bidirectional Long Term Short Term (BiLSTM) and Convolutional Neural Network (CNN) methods for comparison. For a fairer comparison, we not only consider the accuracies but also the energy costs incurred to obtain the respective accuracies in order to assess the accuracy-efficiency trade-off. Our numerical and experimental results show that RC yields a classification accuracy of 85%, which is 3% worse than that of BiLSTM and 2% better than that of CNN, at a relatively lower training and significantly lower inference costs. We hope that our findings highlight the importance of examining the accuracy-efficiency trade-off of various models in the community in order to reduce the overall impact of ANNs training on the environment.

We consider blind equalization for block transmissions over the frequency selective Rayleigh fading channel. In the absence of pilot symbols, the receiver must be able to perform joint equalization and blind channel identification. Relying on a mixed discrete-continuous state-space representation of the communication system, we introduce a blind Bayesian equalization algorithm based on a Gaussian mixture parameterization of the a posteriori probability density function (pdf) of the transmitted data and the channel. The performances of the proposed algorithm are compared with existing blind equalization techniques using numerical simulations for quasi-static and time-varying frequency selective wireless channels.