arrow
返回

Relation-Aware Compositional Zero-Shot Learning for Attribute-Object Pair Recognition

delete2022-01-01
delete9
delete
OA
AI
Z
Ziwei Xu *
G
Guangzhi Wang
Y
Yongkang Wong
M
Mohan Kankanhalli
DOI:10.1109/TMM.2021.3104411delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes a novel model for recognizing images with composite attribute-object concepts, notably for composite concepts that are unseen during model training. We aim to explore the three key properties required by the task - relation-aware, consistent, and decoupled-to learn rich and robust features for primitive concepts that compose attribute-object pairs. To this end, we propose the Blocked Message Passing Network (BMP-Net). The model consists of two modules. The concept module generates semantically meaningful features for primitive concepts, whereas the visual module extracts visual features for attributes and objects from input images. A message passing mechanism is used in the concept module to capture the relations between primitive concepts. Furthermore, to prevent the model from being biased towards seen composite concepts and reduce the entanglement between attributes and objects, we propose a blocking mechanism that equalizes the information available to the model for both seen and unseen concepts. Extensive experiments and ablation studies on two benchmarks show the efficacy of the proposed model.
Keyword:
Visualization
Task analysis
Semantics
Training
Image recognition
Feature extraction
Computational modeling
Compositional zero-shot learning
image recognition
message passing

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
err分享
err收藏
Sensitivity of the Flow Number to Mix Factors of Hot-Mix Asphalt
err2019-06-07
err0
errOAAI
errMd Rashadul Islam; Sylvester A. Kalevela; Shelby K. Nesselhauf
err分享
err收藏
Clinical Presentation and Anatomical Location of Orbital Plasmacytomas
err2018-05-01
err0
PREAI
errBradley A. Thuro; Oded Sagiv; Roman Shinder; J. Matthew Debnam; Omar Ozgur; John D. Ng; Daniel Rootman; Sheeba K. Thomas; Bita Esmaeli
err分享
err收藏
A serological survey of antibodies against bovine herpesvirus-1 in yak (Poephagus grunniens) in Arunachal Pradesh in India
err2009-12-01
err0
errOAAI
errS.K. BANDYOPADHYAY; D. CHAKRABORTY; T. SARKAR; B. PAL; D. SASMAL; T.K. BISWAS; M.K. GHOSH; M. SARKAR
err分享
err收藏
err分享
err收藏
学者 查看更多内容