Back to Search Start Over

TGLFusion: A Temperature-Guided Lightweight Fusion Method for Infrared and Visible Images.

Authors :
Yan, Bao
Zhao, Longjie
Miao, Kehua
Wang, Song
Li, Qinghua
Luo, Delin
Source :
Sensors (14248220). 3/15/2024, Vol. 24 Issue 6, p1735. 21p.
Publication Year :
2024

Abstract

The fusion of infrared and visible images is a well-researched task in computer vision. These fusion methods create fused images replacing the manual observation of single sensor image, often deployed on edge devices for real-time processing. However, there is an issue of information imbalance between infrared and visible images. Existing methods often fail to emphasize temperature and edge texture information, potentially leading to misinterpretations. Moreover, these methods are computationally complex, and challenging for edge device adaptation. This paper proposes a method that calculates the distribution proportion of infrared pixel values, allocating fusion weights to adaptively highlight key information. It introduces a weight allocation mechanism and MobileBlock with a multispectral information complementary module, innovations which strengthened the model's fusion capabilities, made it more lightweight, and ensured information compensation. Training involves a temperature-color-perception loss function, enabling adaptive weight allocation based on image pair information. Experimental results show superiority over mainstream fusion methods, particularly in the electric power equipment scene and publicly available datasets. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
14248220
Volume :
24
Issue :
6
Database :
Academic Search Index
Journal :
Sensors (14248220)
Publication Type :
Academic Journal
Accession number :
176387183
Full Text :
https://doi.org/10.3390/s24061735