1. DAEANet: Dual auto-encoder attention network for depth map super-resolution
- Author
-
Xiang Cao, Liangqi Zhang, Qi Feng, Xianyi Zhu, Tianjiang Wang, Yihao Luo, Yan Xu, and Haibo Shen
- Subjects
Structure (mathematical logic) ,0209 industrial biotechnology ,business.industry ,Computer science ,Cognitive Neuroscience ,Process (computing) ,Pattern recognition ,02 engineering and technology ,Convolutional neural network ,Autoencoder ,Computer Science Applications ,Image (mathematics) ,Dual (category theory) ,020901 industrial engineering & automation ,Artificial Intelligence ,Feature (computer vision) ,Depth map ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Artificial intelligence ,business - Abstract
Recently, depth map super-resolution (DSR) has obtained remarkable performance with the development of convolutional neural networks (CNNs). High-resolution (HR) depth map can be inferred from a low-resolution (LR) one with the guidance of its corresponding HR intensity image. However, most of the existing CNNs-based methods unilaterally transfer structures information of guidance image to the input depth map, which ignores the corresponding relations between the depth map and the intensity map. In this paper, we propose a novel dual auto-encoder attention network (DAEANet) for DSR. The proposed DAEANet includes two auto-encoder networks, where guidance auto-encoder network (GAENet) and target auto-encoder network (TAENet) aim to extract feature information from intensity image and depth map. Specifically, all auto-encoder networks are similar and trained simultaneously to ensure structural consistency. Furthermore, to preserve the structure information in the process of training, the attention mechanism is employed to our DAEANet. Extensive experiments on several popular benchmarks show that the proposed DAEANet outperforms existing state-of-the-art algorithms.
- Published
- 2021