arrow
Return

Dual-Stream Contrastive Learning for Compositional Zero-Shot Recognition

delete2024-01-01
delete4
PRE
AI
R
Rui Pan
X
Xiangyu Li
X
Xu Yang
邓
邓程 (Cheng Deng) *
DOI:10.1109/TMM.2023.3243674delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Compositional Zero-Shot learning (CZSL) requires recognizing unseen attribute-object compositions using observed visual primitives attributes and objects in a training set, which is a critical capacity for learning systems because the long tail of new combinations dominates the distribution in the real world. However, CZSL is a challenging problem because learning systems tend to learn the dependencies between objects and attributes, which is not conducive to composition classification, and incorrect dependencies will mislead the classification of new combinations of known attributes and objects. This paper primarily introduces a novel yet effective dual-stream contrastive learning method with two main objectives: making the learned representations discriminative and transferring knowledge more efficiently from seen to unseen compositions. Specifically, we generate positive and negative pairs based on the similarity of different concepts (attributes and objects), independently capturing the discriminative representations of concepts. Meanwhile, unlike existing contrastive methods that select negative samples randomly, we construct confusable compositional representations as the negatives to explore the intrinsic relevance between attributes and objects, which can improve the generalization from seen to unseen compositions. Experimental results on two benchmarks show that the proposed method outperforms the state-of-the-arts.
Keywords:
Compositional Zero-Shot learning
contrastive learning
transfer learning

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.7K
Citations:
2.4W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

errShare
errSave
Spreading of extrinsic grain boundary dislocations in plastically deformed aluminium
err1978-02-16
err0
PREAI
errR. A. Varin; J. W. Wyrzykowski; W. Łojkowski; M. W. Grabski
errShare
errSave
Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
errShare
errSave
Adaptive Bias-Aware Feature Generation for Generalized Zero-Shot Learning
err2023-01-01
err15
PREAI
errYang, Yanhua; Zhang, Xiaozhe; Yang, Muli; Deng, Cheng
errShare
errSave
errShare
errSave
Learning MLatent Representations for Generalized Zero-Shot Learning
err2023-01-01
err6
PREAI
errYe, Yalan; Pan, Tongjie; Luo, Tonghoujun; Li, Jingjing; Shen, Heng Tao
errShare
errSave
Cardiovascular diseases risk prediction in patients with diabetes: Posthoc analysis from a matched case-control study in Bangladesh
err2021-02-15
err0
errOAAI
errSheikh Mohammed Shariful Islam; Shyfuddin Ahmed; Riaz Uddin; Muhammad U. Siddiqui; Mahsa Malekahmadi; Abdullah Al Mamun; Roohallah Alizadehsani; Abbas Khosravi; Saeid Nahavandi
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more