1. 基于Im2col的并行深度卷积神经网络优化算法.
- Author
-
胡健, 龚克, 毛伊敏, 陈志刚, and 陈亮
- Subjects
- *
ARTIFICIAL neural networks , *CONVOLUTIONAL neural networks , *FEATURE extraction , *MATHEMATICAL optimization , *ALGORITHMS , *PARALLEL algorithms - Abstract
In the large data environment, there are many problems in the parallel deep convolution neural network(DCNN) algorithm, such as excessive data redundancy, slow convolution layer operation and poor convergence of loss function. This paper proposed a parallel deep convolution neural network optimization algorithm based on the Im2 col method. First, the algorithm proposed a parallel feature extraction strategy based on Marr-Hildreth operator to extract target features from data as input of convolution neural network, which can effectively avoid the problem of excessive data redundancy. Secondly, the algorithm designed a parallel model training strategy based on the Im2 col method. The redundant convolution kernel is removed by designing the Mahalanobis distance center value, and the convolution layer operation speed is improved by combining the MapReduce and Im2 col methods. Finally, the algorithm proposed an improved small-batch gradient descent strategy, which eliminates the effect of abnormal data on the batch gradient and solves the problem of poor convergence of the loss function. The experimental results show that IA-PDCNNOA algorithm performs well in deep convolution neural network calculation under large data environment and is suitable for parallel DCNN model training of large datasets. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF