Back to Search Start Over

A self‐supervised monocular depth estimation model with scale recovery and transfer learning for construction scene analysis.

Authors :
Shen, Jie
Yan, Wenjie
Qin, Shengxian
Zheng, Xiaoyu
Source :
Computer-Aided Civil & Infrastructure Engineering. Jun2023, Vol. 38 Issue 9, p1142-1161. 20p.
Publication Year :
2023

Abstract

Estimating the depth of a construction scene from a single red‐green‐blue image is a crucial prerequisite for various applications, including work zone safety, localization, productivity analysis, activity recognition, and scene understanding. Recently, self‐supervised representation learning methods have made significant progress and demonstrated state‐of‐the‐art performance on monocular depth estimation. However, the two leading open challenges are the ambiguity of estimated depth up to an unknown scale and representation transferability for a downstream task, which severely hinders the practical deployment of self‐supervised methods. We propose a prior information‐based method, not depending on additional sensors, to recover the unknown scale in monocular vision and predict per‐pixel absolute depth. Moreover, a new learning paradigm for a self‐supervised monocular depth estimation model is constructed to transfer the pre‐trained self‐supervised model to other downstream construction scene analysis tasks. Meanwhile, we also propose a novel depth loss to enforce depth consistency when transferring to a new downstream task and two new metrics to measure transfer performance. Finally, we verify the effectiveness of scale recovery and representation transferability in isolation. The new learning paradigm with our new metrics and depth loss is expected to estimate the monocular depth of a construction scene without depth ground truth like light detection and ranging. Our models will serve as a good foundation for further construction scene analysis tasks. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10939687
Volume :
38
Issue :
9
Database :
Academic Search Index
Journal :
Computer-Aided Civil & Infrastructure Engineering
Publication Type :
Academic Journal
Accession number :
163743293
Full Text :
https://doi.org/10.1111/mice.12938