arrow
返回

Rebalanced Zero-Shot Learning

delete2023-01-01
delete3
delete
OA
AI
Z
Zihan Ye
G
Guanyu Yang
X
Xiaobo Jin *
Y
Youfa Liu
K
Kaizhu Huang
DOI:10.1109/TIP.2023.3295738delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Zero-shot learning (ZSL) aims to identify unseen classes with zero samples during training. Broadly speaking, present ZSL methods usually adopt class-level semantic labels and compare them with instance-level semantic predictions to infer unseen classes. However, we find that such existing models mostly produce imbalanced semantic predictions, i.e. these models could perform precisely for some semantics, but may not for others. To address the drawback, we aim to introduce an imbalanced learning framework into ZSL. However, we find that imbalanced ZSL has two unique challenges: (1) Its imbalanced predictions are highly correlated with the value of semantic labels rather than the number of samples as typically considered in the traditional imbalanced learning; (2) Different semantics follow quite different error distributions between classes. To mitigate these issues, we first formalize ZSL as an imbalanced regression problem which offers empirical evidences to interpret how semantic labels lead to imbalanced semantic predictions. We then propose a re-weighted loss termed Re-balanced Mean-Squared Error (ReMSE), which tracks the mean and variance of error distributions, thus ensuring rebalanced learning across classes. As a major contribution, we conduct a series of analyses showing that ReMSE is theoretically well established. Extensive experiments demonstrate that the proposed method effectively alleviates the imbalance in semantic prediction and outperforms many state-of-the-art ZSL methods.
Keyword:
Zero-shot learning
imbalanced regression
semantic prediction
reweighting strategy

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

H
Huazhong Agricultural University
学者数:
3.2W
论文数: 1.8W
被引数: 3.5W
D
Duke Kunshan University
学者数:
1.1K
论文数: 998
被引数: 1.5K
引用论文

引用论文

Multi-stage activation of brown-coal chars with oxygen
errFuel
IF0
err1977-07-01
err0
PREAI
errKazimierz Tomków; Teresa Siemieniewska; Anna Jankowska; Franciszek Czechowski
err分享
err收藏
Design and realization of a mobile wheelchair robot for all terrains
err2012-04-02
err0
PREAI
errChun-Ta Chen; Chieh-Chuan Feng; Yu-An Hsieh
err分享
err收藏
err分享
err收藏
err分享
err收藏
Sa1255 Perianal Complications in an Asian Crohn's Disease Cohort
err2012-05-01
err0
errOAAI
errValerie Tan; Kelvin T. Thia; Wei Lin Tay; Benjamin A. Haaland; Chris San Choon Kong; Wee Chian Lim; Michelle A. Gowans; Jeannie Ong; David E. Ong; Marion Aw; Poh Seng Tan; Hui Ping Chu; Khoon-Lin Ling; Choon Jin Ooi
err分享
err收藏
The (European) Derisking State
err
IF0
err2023-05-17
err0
errOAAI
errDaniela Gabor
err分享
err收藏
学者 查看更多内容