返回
A zero-shot learning framework via cluster-prototype matching
DOI:10.1016/j.patcog.2021.108469.png)
摘要
En 中文
Given the descriptions of classes, Zero-Shot Learning (ZSL) aims to recognize unseen samples by learning a projection between the visual features of samples and the semantic descriptions (prototypes) of classes from seen data. However, due to the inherent distribution gap between seen and unseen domains, the learned projection is generally biased to seen classes and may produce misleading relationships between unseen samples and prototypes (sample-prototype relationship). To tackle this problem, we propose a Cluster-Prototype Matching (CPM) framework which exploits the distribution information of samples to explore the cluster structure of samples and then use the robust cluster-prototype relationship to correct the biased sample-prototype relationship. Specifically, we first use an iterative cluster generation mod-ule to identify the underlying cluster structure of samples based on their embedding features, which are acquired via a basic ZSL model. Then each identified cluster will be matched with a specific class pro-totype through the Kuhn-Munkres algorithm, based on which we can export a sharp cluster-prototype similarity. Finally, the cluster-prototype similarity is combined with the sample-prototype similarity to determine the class labels of test samples. We apply CPM to five well-established ZSL methods and the experimental results show that CPM can significantly improve the performance of basic models and en-able them achieve or beyond the state-of-the-art. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Zero-shot learning
Image classification
Cluster-prototype matching
Domain shift
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
U2-Net: Going deeper with nested U-structure for salient object detectionU2-Net: 基于嵌套U结构的显著性目标检测
PATTERN RECOGNITION
IF7.6
Temperature network for few-shot learning with distribution-aware large-margin metric
PATTERN RECOGNITION
IF7.6
Transcatheter occlusion of the persistently patent ductus arteriosus. Forty-month follow-up and prevalence of residual shunting.
Circulation
IF0
Hydrothermal preparation and low temperature magnetic properties of TbOOH, DyOOH, HoOOH, ErOOH, and YbOOHTbOOH,DyOOH,HoOOH,ErOOH和YbOOH的水热制备和低温磁性
Deep transductive network for generalized zero shot learning用于广义零射击学习的深度转导网络
PATTERN RECOGNITION
IF7.6
Guided CNN for generalized zero-shot and open-set recognition using visual and semantic prototypes使用视觉和语义原型进行广义零拍和开放集识别的引导CNN
PATTERN RECOGNITION
IF7.6

