返回
Deep Ranking for Image Zero-Shot Multi-Label Classification
DOI:10.1109/TIP.2020.2991527.png)
摘要
En 中文
During the past decade, both multi-label learning and zero-shot learning have attracted huge research attention, and significant progress has been made. Multi-label learning algorithms aim to predict multiple labels given one instance, while most existing zero-shot learning approaches target at predicting a single testing label for each unseen class via transferring knowledge from auxiliary seen classes to target unseen classes. However, relatively less effort has been made on predicting multiple labels in the zero-shot setting, which is nevertheless a quite challenging task. In this work, we investigate and formalize a flexible framework consisting of two components, i.e., visual-semantic embedding and zero-shot multi-label prediction. First, we present a deep regression model to project the visual features into the semantic space, which explicitly exploits the correlations in the intermediate semantic layer of word vectors and makes label prediction possible. Then, we formulate the label prediction problem as a pairwise one and employ Ranking SVM to seek the unique multi-label correlations in the embedding space. Furthermore, we provide a transductive multi-label zero-shot prediction approach that exploits the testing data manifold structure. We demonstrate the effectiveness of the proposed approach on three popular multi-label datasets with state-of-the-art performance obtained on both conventional and generalized ZSL settings.
Keyword:
Testing
Training
Predictive models
Semantics
Correlation
Visualization
Training data
Multi-label classification
zero-shot learning
visual-semantic embedding
transductive learning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Efficient max-margin multi-label classification with applications to zero-shot learning
MACHINE LEARNING
IF2.9
Loosening of Side-Chain Packing Associated with Perturbations in Peripheral Dynamics Induced by the D76N Mutation of β2-Microglobulin Revealed by Pressure-NMR and Molecular Dynamic Simulations
Biomolecules
IF0

