arrow
返回

A zero-shot learning framework via cluster-prototype matching

delete2022-04-01
delete12
PRE
AI
J
Jing Zhang
李
李清勇 (Qingyong Li) *
Y
Yangli‐ao Geng
王
王文 (Wen Wang)
W
Wenju Sun
C
Chuan Shi
Z
Zhengming Ding
DOI:10.1016/j.patcog.2021.108469delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Given the descriptions of classes, Zero-Shot Learning (ZSL) aims to recognize unseen samples by learning a projection between the visual features of samples and the semantic descriptions (prototypes) of classes from seen data. However, due to the inherent distribution gap between seen and unseen domains, the learned projection is generally biased to seen classes and may produce misleading relationships between unseen samples and prototypes (sample-prototype relationship). To tackle this problem, we propose a Cluster-Prototype Matching (CPM) framework which exploits the distribution information of samples to explore the cluster structure of samples and then use the robust cluster-prototype relationship to correct the biased sample-prototype relationship. Specifically, we first use an iterative cluster generation mod-ule to identify the underlying cluster structure of samples based on their embedding features, which are acquired via a basic ZSL model. Then each identified cluster will be matched with a specific class pro-totype through the Kuhn-Munkres algorithm, based on which we can export a sharp cluster-prototype similarity. Finally, the cluster-prototype similarity is combined with the sample-prototype similarity to determine the class labels of test samples. We apply CPM to five well-established ZSL methods and the experimental results show that CPM can significantly improve the performance of basic models and en-able them achieve or beyond the state-of-the-art. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Zero-shot learning
Image classification
Cluster-prototype matching
Domain shift

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
T
tulane university
学者数:
1.3W
论文数: 1.0W
被引数: 9
学者 查看更多机构
引用论文

引用论文

U2-Net: Going deeper with nested U-structure for salient object detectionU2-Net: 基于嵌套U结构的显著性目标检测
err2020-10-01
err1.2K
errOAAI
errQin, Xuebin; Zhang, Zichen; Huang, Chenyang; Dehghan, Masood; Zaiane, Osmar R.; Jagersand, Martin
err分享
err收藏
err分享
err收藏
The (European) Derisking State
err
IF0
err2023-05-17
err0
errOAAI
errDaniela Gabor
err分享
err收藏
err分享
err收藏
Deep forest hashing for image retrieval
err2019-11-01
err42
PREAI
errZhou, Meng; Zeng, Xianhua; Chen, Aozhu
err分享
err收藏
err分享
err收藏
学者 查看更多内容