Back to Search Start Over

A Multi-Task Collaborative Network for Light Field Salient Object Detection.

Authors :
Zhang, Qiudan
Wang, Shiqi
Wang, Xu
Sun, Zhenhao
Kwong, Sam
Jiang, Jianmin
Source :
IEEE Transactions on Circuits & Systems for Video Technology. May2021, Vol. 31 Issue 5, p1849-1861. 13p.
Publication Year :
2021

Abstract

Being able to predict the salient object is of fundamental importance in image processing and computer vision. With numerous approaches proposed for automatic image and video salient object detection, much less work has been dedicated to detecting and segmenting salient objects from light fields. In this article, based on the intrinsic characteristics of light fields, we carefully explore the complementary coherence among multiple cues including spatial, edge and depth information, and elaborately design a multi-task collaborative network for light field salient object detection. More specifically, the correlation mechanisms among edge detection, depth inference and salient object detection are carefully investigated to facilitate the representative saliency features. We first model the coherence among low-level features and heuristic semantic priors, as well as the edge information. Subsequently, the depth-oriented saliency features are derived from the geometry of light fields, in which the 3D convolution operation is leveraged with powerful representation capability to model the disparity correlations among multiple viewpoint images. Finally, a feature-enhanced salient object generator is developed to integrate these complementary saliency features, leading to the final salient object predictions for light fields. Quantitative and qualitative experiments demonstrate the superiority of our proposed model against the state-of-the-art methods over the public light field salient object detection datasets. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10518215
Volume :
31
Issue :
5
Database :
Academic Search Index
Journal :
IEEE Transactions on Circuits & Systems for Video Technology
Publication Type :
Academic Journal
Accession number :
150190031
Full Text :
https://doi.org/10.1109/TCSVT.2020.3013119