1. An Enhanced Edge Information Network for Image Denoising via Feature Multi-Modulation Attention
- Author
-
Zitong Wang, Hang Zhao, Chenyi Zhao, Tian Zhang, and Shuang Qiao
- Subjects
Image denoising ,attention mechanism ,gradient estimation ,LoG sharpening loss ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Effective preservation of high-frequency information such as edges and textures remains an open challenge in image denoising, with existing methods susceptible to noisy interference and poor consistency with human visual quality. To address this limitation, we propose a novel enhanced edge information network for image denoising via feature multi-modulation attention, namely ${\text {M}}^{2}$ A ${\text {E}}^{2}$ Net, for complex denoising tasks on both real and synthetic images. This method divides the conventional maximum likelihood estimation framework into three sub-problems solved collaboratively: (i) image reconstruction, (ii) gradient estimation, and (iii) detail refinement. These objectives are implemented through the integration of two sub-networks: Reconstruction and gradient estimation networks. First, we propose an end-to-end gradient loss function imposed on gradient estimation network to acquire noise-free gradient maps, which guides ${\text {M}}^{2}$ A ${\text {E}}^{2}$ Net to focus on regions abundant with rich edges and contours. Furthermore, to achieve effective feature representation of noisy images synchronously and dynamically in the reconstruction network, we propose a novel feature multi-modulation attention module to adaptively integrate gradient images obtained by the gradient estimation network into input images as an edge prior information. The Laplacian of Gaussian sharpening loss function is also proposed to enhance the preservation of edges and textures, as demonstrated by higher SSIM metric and perceptual quality of denoised images. Our approach leverages the advantages of deep learning while benefiting from classical filter-based methods. Experimental results demonstrate the promising performance of ${\text {M}}^{2}$ A ${\text {E}}^{2}$ Net in terms of PSNR and SSIM metrics and better visual quality of denoised images. The code is available at https://github.com/Wangzt1121/M2AE2Net.
- Published
- 2024
- Full Text
- View/download PDF