arrow
返回

Dual-Stream Contrastive Learning for Compositional Zero-Shot Recognition

delete2024-01-01
delete4
PRE
AI
R
Rui Pan
X
Xiangyu Li
X
Xu Yang
邓程 (Cheng Deng) *
DOI:10.1109/TMM.2023.3243674delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Compositional Zero-Shot learning (CZSL) requires recognizing unseen attribute-object compositions using observed visual primitives attributes and objects in a training set, which is a critical capacity for learning systems because the long tail of new combinations dominates the distribution in the real world. However, CZSL is a challenging problem because learning systems tend to learn the dependencies between objects and attributes, which is not conducive to composition classification, and incorrect dependencies will mislead the classification of new combinations of known attributes and objects. This paper primarily introduces a novel yet effective dual-stream contrastive learning method with two main objectives: making the learned representations discriminative and transferring knowledge more efficiently from seen to unseen compositions. Specifically, we generate positive and negative pairs based on the similarity of different concepts (attributes and objects), independently capturing the discriminative representations of concepts. Meanwhile, unlike existing contrastive methods that select negative samples randomly, we construct confusable compositional representations as the negatives to explore the intrinsic relevance between attributes and objects, which can improve the generalization from seen to unseen compositions. Experimental results on two benchmarks show that the proposed method outperforms the state-of-the-arts.
Keyword:
Compositional Zero-Shot learning
contrastive learning
transfer learning

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

err分享
err收藏
Spreading of extrinsic grain boundary dislocations in plastically deformed aluminium
err1978-02-16
err0
PREAI
errR. A. Varin; J. W. Wyrzykowski; W. Łojkowski; M. W. Grabski
err分享
err收藏
Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
err分享
err收藏
Adaptive Bias-Aware Feature Generation for Generalized Zero-Shot Learning
err2023-01-01
err15
PREAI
errYang, Yanhua; Zhang, Xiaozhe; Yang, Muli; Deng, Cheng
err分享
err收藏
err分享
err收藏
Learning MLatent Representations for Generalized Zero-Shot Learning
err2023-01-01
err6
PREAI
errYe, Yalan; Pan, Tongjie; Luo, Tonghoujun; Li, Jingjing; Shen, Heng Tao
err分享
err收藏
Cardiovascular diseases risk prediction in patients with diabetes: Posthoc analysis from a matched case-control study in Bangladesh
err2021-02-15
err0
errOAAI
errSheikh Mohammed Shariful Islam; Shyfuddin Ahmed; Riaz Uddin; Muhammad U. Siddiqui; Mahsa Malekahmadi; Abdullah Al Mamun; Roohallah Alizadehsani; Abbas Khosravi; Saeid Nahavandi
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容