1. 基于坐标注意力的重参数化红外与 可见光图像融合网络.
- Author
-
朱丹辰, 张亚, 马精彬, and 王晓明
- Abstract
Aiming at the two problems that most existing deep network-based fusion approaches have complex network architecture with high computation cost, and they fail to adequately consider the intrinsic characteristics of multi-modal images which results in insufficient information interaction of cross-modality features, a re-parameterized infrared and visible image fusion network based on coordinate attention is proposed. In this network, re-parameterization technique is introduced and combined with residual learning to perform feature extraction for computing efficiency and satisfying fusion quality. Moreover, to improve the interactivity of cross-modality features and fully utilize multi-modal image information, a coordinate attention-based fusion module is devised to yield fused feature. Considering the information loss during extracting process, a fused feature enhance module which leverages the preceding cross-modality features to implement feature compensation is further developed. Extensive experiments demonstrate that the proposed method not only has lower computational cost, but also achieves the improvement of multiple objective evaluation metrics while ensuring good visual effects. [ABSTRACT FROM AUTHOR]
- Published
- 2024