Back to Search Start Over

Learning discriminative foreground-and-background features for few-shot segmentation.

Authors :
Jiang, Cong
Zhou, Yange
Liu, Zhaoshuo
Feng, Chaolu
Li, Wei
Yang, Jinzhu
Source :
Multimedia Tools & Applications; May2024, Vol. 83 Issue 18, p55999-56019, 21p
Publication Year :
2024

Abstract

Few-shot Semantic Segmentation (FSS) endeavors to segment novel categories in a query image by referring to a support set comprising only a few annotated examples. Presently, many existing FSS methodologies primarily embrace the prototype learning paradigm and concentrate on optimizing the matching mechanism. However, these approaches tend to overlook the discrimination between the features of foreground background. Consequently, the segmentation results are often imprecise when it comes to capturing intricate structures, such as boundaries and small objects. In this study, we introduce the Discriminative Foreground-and-Background feature learning Network (DFBNet) to enhance the distinguishability of bilateral features. DFBNet comprises three major modules: a multi-level self-matching module (MSM), a feature separation module (FSM), and a semantic alignment module (SAM). The MSM generates prior masks separately for the foreground and background, employing a self-matching strategy across different feature levels. These prior masks are subsequently used as scaling factors within the FSM, where the features of the query's foreground and background are independently scaled up and then concatenated along the channel dimension. Furthermore, we incorporate a two-layer Transformer encoder-based semantic alignment module (SAM) in DFBNet to refine the features, thereby creating a greater distinction between the foreground and background features. The performance of DFBNet is evaluated on the PASCAL- 5 i and COCO- 20 i benchmarks, demonstrating its superiority over existing solutions and establishing new state-of-the-art results in the field of few-shot semantic segmentation. The codes will be released if this paper is accepted. [ABSTRACT FROM AUTHOR]

Subjects

Subjects :
MARKOV random fields
PROTOTYPES

Details

Language :
English
ISSN :
13807501
Volume :
83
Issue :
18
Database :
Complementary Index
Journal :
Multimedia Tools & Applications
Publication Type :
Academic Journal
Accession number :
177251104
Full Text :
https://doi.org/10.1007/s11042-023-17708-5