1. An Improved Convolutional Neural Network Based on Noise Layer
- Author
-
Zhaoyang Wang and Shaowei Pan
- Subjects
Generalization ,Computer science ,business.industry ,Computer Science::Neural and Evolutionary Computation ,Pattern recognition ,Overfitting ,Convolutional neural network ,Convolution ,Noise ,Interference (communication) ,Feature (computer vision) ,Position (vector) ,Computer Science::Computer Vision and Pattern Recognition ,Artificial intelligence ,business - Abstract
In order to solve the over-fitting problem in Convolutional Neural Networks (CNN), a new method to improve the performance of CNN with noise layer on the basis of the previous studies has been proposed. This method improves the generalization performance of the CNN model by adding corresponding noise to the feature image obtained after convolution operation. The constructed noise layer can be flexibly embedded in a certain position of the CNN structure, and with each iteration of training, the added noise is also constantly changing, which makes the interference to the CNN model more profound, thus the more essential features of the input image are obtained. The experimental results show that the improved CNN model based on the noise layer has better recognition effect on some test images than the CNN model without any improvement; for different CNN models, the position of the noise layer which can improve the recognition accuracy is different; as the number of layers deepens, to improve the generalization performance of the CNN model, the position of the noise layer needs to be moved back. The improved CNN model based on the noise layer proposed in this paper solves the overfitting problem to a certain extent, and it has a certain reference significance for studying how to improve the generalization performance of CNN.
- Published
- 2021
- Full Text
- View/download PDF