Back to Search Start Over

Super-Resolution Neural Radiance Field via Learning High Frequency Details for High-Fidelity Novel View Synthesis

Authors :
Lee, Han-nyoung
Kim, Hak Gu
Source :
IEEE Signal Processing Letters; 2024, Vol. 31 Issue: 1 p466-470, 5p
Publication Year :
2024

Abstract

While neural rendering approaches facilitate photo-realistic rendering in novel view synthesis tasks, the challenge of high-resolution rendering persists due to the substantial costs associated with acquiring and training data. Recently, several studies have been proposed that render high-resolution scenes by either super-sampling points or using reference images, aiming to restore details in low-resolution (LR) images. However, super-sampling is computationally expensive, and methods with reference images require high-resolution (HR) images for inference. In this letter, we propose a novel super-resolution (SR) neural radiance field (NeRF) framework for high-fidelity novel view synthesis. To address the representation of high-fidelity HR images from the captured LR images, we learn a mapping function that maps LR rendering images to the Fourier space to restore insufficient high frequency details and render HR images at higher resolution. Experiments demonstrate that our results are quantitatively and qualitatively better than those of the existing SR methods in novel view synthesis. By visualizing the estimated dominant frequency components, we provide visual interpretations of the performance improvement.

Details

Language :
English
ISSN :
10709908 and 15582361
Volume :
31
Issue :
1
Database :
Supplemental Index
Journal :
IEEE Signal Processing Letters
Publication Type :
Periodical
Accession number :
ejs65420957
Full Text :
https://doi.org/10.1109/LSP.2024.3358101