151. Semantic monocular depth estimation based on artificial intelligence
- Author
-
Antonio M. López, Onay Urfalioglu, Akhil Gurram, Fahd Bouzaraa, Ibrahim Halfaoui, and Urfalıoğlu, Onay
- Subjects
Ground truth ,Monocular ,Computer science ,business.industry ,Mechanical Engineering ,Deep learning ,Semantics ,Machine learning ,computer.software_genre ,Semantic segmentation ,Computer Science Applications ,Constraint (information theory) ,Multi-task learning ,Automotive Engineering ,Line (geometry) ,Task analysis ,Segmentation ,Artificial intelligence ,business ,computer ,Monocular depth estimation - Abstract
Depth estimation provides essential information to perform autonomous driving and driver assistance. A promising line of work consists of introducing additional semantic information about the traffic scene when training CNNs for depth estimation. In practice, this means that the depth data used for CNN training is complemented with images having pixel-wise semantic labels where the same raw training data is associated with both types of ground truth, i.e., depth and semantic labels. The main contribution of this paper is to show that this hard constraint can be circumvented, i.e., that we can train CNNs for depth estimation by leveraging the depth and semantic information coming from heterogeneous datasets. In order to illustrate the benefits of our approach, we combine KITTI depth and Cityscapes semantic segmentation datasets, outperforming state-of-the-art results on monocular depth estimation.
- Published
- 2021