Back to Search Start Over

Video object segmentation via couple streams and feature memory.

Authors :
Liang, Yun
Xiao, Xinjie
Qiu, Shaojian
Zhang, Yuqing
Su, Zhuo
Source :
IET Image Processing (Wiley-Blackwell); Jul2024, Vol. 18 Issue 9, p2257-2272, 16p
Publication Year :
2024

Abstract

In recent years, most video segmentation methods use deep CNN to process the input image, but they did not fully mine the rich intermediate predictions in spatio‐temporal space. And, the segmentation challenges such as occlusion, severe deformation and illumination have not been well solved so far. To alleviate these problems, this paper focuses on constructing multi module network structures that represent multi semantics and proposes a video object segmentation network via coupled‐stream architecture with feature memory mechanism. This network first extracts high‐level semantic features, edge features, long‐term and short‐term stable depth features of the target, and then decode them into the segmentation mask of target. In addition, negative skeleton inhibition and frame interpolation are used to prevent the interference of similar objects and motion blur, respectively. The method has a low GPU memory usage, regardless of the number of object in video. And performs 86.5%and 62.4% in J&F measure on DAVIS 2016 and DAVIS 2017 validation set, without fine‐tuning and online training. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
17519659
Volume :
18
Issue :
9
Database :
Complementary Index
Journal :
IET Image Processing (Wiley-Blackwell)
Publication Type :
Academic Journal
Accession number :
178297532
Full Text :
https://doi.org/10.1049/ipr2.13051