Back to Search
Start Over
Fusion of infrared and visible images via multi-layer convolutional sparse representation
- Source :
- Journal of King Saud University: Computer and Information Sciences, Vol 36, Iss 6, Pp 102090- (2024)
- Publication Year :
- 2024
- Publisher :
- Elsevier, 2024.
-
Abstract
- Infrared and visible image fusion is an effective solution for image quality enhancement. However, conventional fusion models require the decomposition of source images into image blocks, which disrupts the original structure of the images, leading to the loss of detail in the fused images and making the fusion results highly sensitive to matching errors. This paper employs Convolutional Sparse Representation (CSR) to perform global feature transformation on the source images, overcoming the drawbacks of traditional fusion models that rely on image decomposition. Inspired by neural networks, a multi-layer CSR model is proposed, which involves five layers in a forward-feeding manner: two CSR layers acquiring sparse coefficient maps, one fusion layer combining sparse maps, and two reconstruction layers for image recovery. The dataset used in this paper comprises infrared and visible images selected from public dataset, as well as registered images collected by an actual Unmanned Aerial Vehicle (UAV). The source images contain ground targets, marine targets, and natural landscapes. To validate the effectiveness of the proposed image fusion model in this paper, comparative analysis is conducted with state-of-the-art (SOTA) algorithms. Experimental results demonstrate that the proposed fusion model outperforms other state-of-the-art methods by at least 10% in SF, EN, MI and QAB/F fusion metrics in most image fusion cases, thereby affirming its favorable performance.
Details
- Language :
- English
- ISSN :
- 13191578
- Volume :
- 36
- Issue :
- 6
- Database :
- Directory of Open Access Journals
- Journal :
- Journal of King Saud University: Computer and Information Sciences
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.6a71ffb4524421b81f19008f83f0398
- Document Type :
- article
- Full Text :
- https://doi.org/10.1016/j.jksuci.2024.102090