1. Sensitivity based selection of inputs and delays for NARX models
- Author
-
Fabio Moretti and Martin Macas
- Subjects
Engineering ,Nonlinear autoregressive exogenous model ,Artificial neural network ,Autoregressive model ,business.industry ,Control theory ,Stability (learning theory) ,Feedforward neural network ,Pruning (decision trees) ,Sensitivity (control systems) ,Overfitting ,business - Abstract
In this paper, an extension of sensitivity based pruning (SBP) method for Nonlinear AutoRegressive models with eXogenous inputs (NARX) model is presented. Besides the inputs, input and output delays are simultaneously pruned in terms of the backward elimination. The concept is based on replacement of some regressors by their mean value, which corresponds to the removal of influence of the particular regressors from the network. The method is demonstrated on two datasets. Firstly, one artificial generator is used to test if the method is able to find an optimal set of inputs and delays. Further, the method is used for prediction of gas consumption of a simulated heating for an office building. It is shown that the SBP significantly reduces the complexity of the NARX network without any significant performance degradation. Moreover, it is hypothesized than SBP can be more important for NARX than for simple feedforward neural network, because NARX is more prone to overfitting and has problems with stability.
- Published
- 2016
- Full Text
- View/download PDF