arrow
返回

Semantically guided dynamic visual prototype refinement for compositional zero-shot learning

delete2026-01-22
delete0
PRE
AI
Z
Zhong Peng
Y
Yishi Xu
G
Gerong Wang
W
Wenchao Chen
J
Jing Zhang *
B
Bo Chen *
H
Hongwei Liu
DOI:10.1016/j.neucom.2026.132775delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Compositional Zero-Shot Learning (CZSL) seeks to recognize unseen state–object pairs by recombining primitives learned from seen compositions. Despite recent progress with vision–language models (VLMs), two limitations remain: (i) text-driven semantic prototypes are weakly discriminative in the visual feature space; and (ii) unseen pairs are optimized passively, thereby inducing seen bias. To address these limitations, we present Duplex, a framework that couples dual-prototype learning with dynamic local-graph refinement of visual prototypes. For each composition, Duplex maintains a semantic prototype via prompt learning and a visual prototype for unseen pairs constructed by recombining disentangled state and object primitives from seen images. The visual prototypes are updated dynamically through lightweight aggregation on mini-batch local graphs, which incorporate unseen compositions during training without labels. This design introduces fine-grained visual evidence while preserving semantic structure. It enriches class prototypes, better disambiguates semantically similar yet visually distinct pairs, and mitigates seen bias. Experiments on MIT-States, UT-Zappos, and CGQA in closed-world and open-world settings achieve competitive performance and consistent compositional generalization.

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

A
Academy of Military Science
学者数:
148
论文数: 57
被引数: 0
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

err分享
err收藏
Graph embedding based multi-label Zero-shot Learning
err2023-10-01
err6
errOAAI
errZhang, Haigang; Meng, Xianglong; Cao, Weipeng; Liu, Ye; Ming, Zhong; Yang, Jinfeng
err分享
err收藏
err分享
err收藏
Discriminative and Robust Attribute Alignment for Zero-Shot Learning
err2023-08-01
err0
PREAI
errDe Cheng; Gerong Wang; Nannan Wang; Dingwen Zhang; Qiang Zhang; Xinbo Gao
err分享
err收藏
Learning to Prompt for Vision-Language Models学习提示视觉语言模型
err2022-07-31
err654
PREAI
errZhou, Kaiyang; Yang, Jingkang; Loy, Chen Change; Liu, Ziwei
err分享
err收藏
学者 查看更多内容