arrow
返回

Diversity-Boosted Generalization-Specialization Balancing for Zero-Shot Learning

delete2023-01-01
delete6
delete
OA
AI
Y
Yun Li
Z
Zhe Liu *
Xiaojun Chang 封面图
Xiaojun Chang (Xiaojun Chang)
J
Julian McAuley
Lina Yao 封面图
Lina Yao (Lina Yao)
DOI:10.1109/TMM.2023.3236211delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Zero-Shot Learning (ZSL) aims to transfer classification capability from seen to unseen classes. Recent methods have proved that generalization and specialization are two essential abilities to achieve good performance in ZSL. However, focusing on only one of the abilities may result in models that are either too general with degraded classification ability or too specialized to generalize to unseen classes. In this article, we propose an end-to-end network, termed as BGSNet, which equips and balances generalization and specialization abilities at the instance and dataset level. Specifically, BGSNet consists of two branches: the Generalization Network (GNet), which applies episodic meta-learning to learn generalized knowledge, and the Balanced Specialization Network (BSNet), which adopts multiple attentive extractors to extract discriminative features and achieve instance-level balance. A novel self-adjusted diversity loss is designed to optimize BSNet with redundancy reduced and diversity boosted. We further propose a differentiable dataset-level balance and update the weights in a linear annealing schedule to simulate network pruning and thus obtain the optimal structure for BSNet with dataset-level balance achieved. Experiments on four benchmark datasets demonstrate our model's effectiveness. Sufficient component ablations prove the necessity of integrating and balancing generalization and specialization abilities.
Keyword:
Visualization
Feature extraction
Semantics
Training
Schedules
Redundancy
Annealing
Zero-shot learning
meta-learning
dynamic network

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
U
University of California San Diego
学者数:
4.6W
论文数: 3.5W
被引数: 924
学者 查看更多机构
引用论文

引用论文

Precipitation Versus Partitioning Kinetics during the Quenching of Low-Carbon Martensitic Steels
err2020-06-27
err0
errOAAI
errShashank Ramesh Babu; Matias Jaskari; Antti Jarvenpää; Thomas Paul Davis; Jukka Kömi; David Porter
err分享
err收藏
err分享
err收藏
Direct fabrication of rigid microstructures on a metallic roller using a dry film resist
err2007-11-28
err0
PREAI
errLiang-Ting Jiang; Tzu-Chien Huang; Chih-Yuan Chang; Jian-Ren Ciou; Sen-Yeu Yang; Po-Hsun Huang
err分享
err收藏
Zero-Shot Learning With Transferred Samples
err2017-07-01
err84
PREAI
errGuo, Yuchen; Ding, Guiguang; Han, Jungong; Gao, Yue
err分享
err收藏
INVASION OF PRESSURIZED CLAY SUSPENSIONS INTO GRANULAR SOIL
err2013-01-01
err0
PREAI
errA. M. Talmon; D. R. Mastbergen; M. Huisman
err分享
err收藏
学者 查看更多内容