Image Restoration Network Under Complex Meteorological Environment: GRASPP-GAN

The color and contrast of objects in the image will be affected by meteorological factors, especially rain and snow will block part of the image, which will change the information contained in the image. Image restoration under bad weather conditions has practical application value. At present, most of the research focuses on the removal of fog, and the research on complex rain and snow is relatively less. Rain has more prominent features in gradient domain, and it is more distinct from non-rain image texture. In this paper, Generative Adversarial Networks is used to combine the information of image in gradient domain and spatial domain to get better performance of rain removal. Gradient aided coding is used in the generator to generate depth features that are more conducive to rain removal. In the discriminator, the gradient is used as an additional input to provide more recognizable rain and non-rain information, which enhances the discriminator’s ability to distinguish the image generated by the generator and the ground truth. By modifying the network structure of the expanded spatial pyramid pooling (ASPP), the abnormal rain removal results produced by the generator are reduced. Experimental results show that the proposed method improves the performance of rain removal and the visual quality of the generated image.