Back to Search Start Over

Wavelet-based network for high dynamic range imaging.

Authors :
Dai, Tianhong
Li, Wei
Cao, Xilei
Liu, Jianzhuang
Jia, Xu
Leonardis, Ales
Yan, Youliang
Yuan, Shanxin
Source :
Computer Vision & Image Understanding; Jan2024, Vol. 238, pN.PAG-N.PAG, 1p
Publication Year :
2024

Abstract

High dynamic range (HDR) imaging from multiple low dynamic range (LDR) images has been suffering from ghosting artifacts caused by scene and objects motion. Existing methods, such as optical flow based and end-to-end deep learning based solutions, are error-prone either in detail restoration or ghosting artifacts removal. Comprehensive empirical evidence shows that ghosting artifacts caused by large foreground motion are mainly low-frequency signals and the details are mainly high-frequency signals. In this work, we propose a novel frequency-guided end-to-end deep neural network (FHDRNet) to conduct HDR fusion in the frequency domain, and Discrete Wavelet Transform (DWT) is used to decompose inputs into different frequency bands. The low-frequency signals are used to avoid specific ghosting artifacts, while the high-frequency signals are used for preserving details. Using a U-Net as the backbone, we propose two novel modules: merging module and frequency-guided upsampling module. The merging module applies the attention mechanism to the low-frequency components to deal with the ghost caused by large foreground motion. The frequency-guided upsampling module reconstructs details from multiple frequency-specific components with rich details. In addition, a new RAW dataset is created for training and evaluating multi-frame HDR imaging algorithms in the RAW domain. Extensive experiments are conducted on public datasets and our RAW dataset, showing that the proposed FHDRNet achieves state-of-the-art performance. • We have proposed a novel frequency-guided neural network to conduct HDR fusion in the frequency domain. • Our method outperforms other baselines on several public datasets. • We build a new dataset for training HDR imaging methods in the RAW domain. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10773142
Volume :
238
Database :
Supplemental Index
Journal :
Computer Vision & Image Understanding
Publication Type :
Academic Journal
Accession number :
174034552
Full Text :
https://doi.org/10.1016/j.cviu.2023.103881