Back to Search Start Over

Duplex: Dual Prototype Learning for Compositional Zero-Shot Learning

Authors :
Peng, Zhong
Xu, Yishi
Wang, Gerong
Chen, Wenchao
Chen, Bo
Zhang, Jing
Publication Year :
2025

Abstract

Compositional Zero-Shot Learning (CZSL) aims to enable models to recognize novel compositions of visual states and objects that were absent during training. Existing methods predominantly focus on learning semantic representations of seen compositions but often fail to disentangle the independent features of states and objects in images, thereby limiting their ability to generalize to unseen compositions. To address this challenge, we propose Duplex, a novel dual-prototype learning method that integrates semantic and visual prototypes through a carefully designed dual-branch architecture, enabling effective representation learning for compositional tasks. Duplex utilizes a Graph Neural Network (GNN) to adaptively update visual prototypes, capturing complex interactions between states and objects. Additionally, it leverages the strong visual-semantic alignment of pre-trained Vision-Language Models (VLMs) and employs a multi-path architecture combined with prompt engineering to align image and text representations, ensuring robust generalization. Extensive experiments on three benchmark datasets demonstrate that Duplex outperforms state-of-the-art methods in both closed-world and open-world settings.

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.2501.07114
Document Type :
Working Paper