Back to Search
Start Over
Learning discriminative foreground-and-background features for few-shot segmentation.
- Source :
- Multimedia Tools & Applications; May2024, Vol. 83 Issue 18, p55999-56019, 21p
- Publication Year :
- 2024
-
Abstract
- Few-shot Semantic Segmentation (FSS) endeavors to segment novel categories in a query image by referring to a support set comprising only a few annotated examples. Presently, many existing FSS methodologies primarily embrace the prototype learning paradigm and concentrate on optimizing the matching mechanism. However, these approaches tend to overlook the discrimination between the features of foreground background. Consequently, the segmentation results are often imprecise when it comes to capturing intricate structures, such as boundaries and small objects. In this study, we introduce the Discriminative Foreground-and-Background feature learning Network (DFBNet) to enhance the distinguishability of bilateral features. DFBNet comprises three major modules: a multi-level self-matching module (MSM), a feature separation module (FSM), and a semantic alignment module (SAM). The MSM generates prior masks separately for the foreground and background, employing a self-matching strategy across different feature levels. These prior masks are subsequently used as scaling factors within the FSM, where the features of the query's foreground and background are independently scaled up and then concatenated along the channel dimension. Furthermore, we incorporate a two-layer Transformer encoder-based semantic alignment module (SAM) in DFBNet to refine the features, thereby creating a greater distinction between the foreground and background features. The performance of DFBNet is evaluated on the PASCAL- 5 i and COCO- 20 i benchmarks, demonstrating its superiority over existing solutions and establishing new state-of-the-art results in the field of few-shot semantic segmentation. The codes will be released if this paper is accepted. [ABSTRACT FROM AUTHOR]
- Subjects :
- MARKOV random fields
PROTOTYPES
Subjects
Details
- Language :
- English
- ISSN :
- 13807501
- Volume :
- 83
- Issue :
- 18
- Database :
- Complementary Index
- Journal :
- Multimedia Tools & Applications
- Publication Type :
- Academic Journal
- Accession number :
- 177251104
- Full Text :
- https://doi.org/10.1007/s11042-023-17708-5