Back to Search Start Over

Fusion of infrared and visible images via multi-layer convolutional sparse representation

Authors :
Zhouyu Zhang
Chenyuan He
Hai Wang
Yingfeng Cai
Long Chen
Zhihua Gan
Fenghua Huang
Yiqun Zhang
Source :
Journal of King Saud University: Computer and Information Sciences, Vol 36, Iss 6, Pp 102090- (2024)
Publication Year :
2024
Publisher :
Elsevier, 2024.

Abstract

Infrared and visible image fusion is an effective solution for image quality enhancement. However, conventional fusion models require the decomposition of source images into image blocks, which disrupts the original structure of the images, leading to the loss of detail in the fused images and making the fusion results highly sensitive to matching errors. This paper employs Convolutional Sparse Representation (CSR) to perform global feature transformation on the source images, overcoming the drawbacks of traditional fusion models that rely on image decomposition. Inspired by neural networks, a multi-layer CSR model is proposed, which involves five layers in a forward-feeding manner: two CSR layers acquiring sparse coefficient maps, one fusion layer combining sparse maps, and two reconstruction layers for image recovery. The dataset used in this paper comprises infrared and visible images selected from public dataset, as well as registered images collected by an actual Unmanned Aerial Vehicle (UAV). The source images contain ground targets, marine targets, and natural landscapes. To validate the effectiveness of the proposed image fusion model in this paper, comparative analysis is conducted with state-of-the-art (SOTA) algorithms. Experimental results demonstrate that the proposed fusion model outperforms other state-of-the-art methods by at least 10% in SF, EN, MI and QAB/F fusion metrics in most image fusion cases, thereby affirming its favorable performance.

Details

Language :
English
ISSN :
13191578
Volume :
36
Issue :
6
Database :
Directory of Open Access Journals
Journal :
Journal of King Saud University: Computer and Information Sciences
Publication Type :
Academic Journal
Accession number :
edsdoj.6a71ffb4524421b81f19008f83f0398
Document Type :
article
Full Text :
https://doi.org/10.1016/j.jksuci.2024.102090