arrow
返回

Indirect visual-semantic alignment for generalized zero-shot recognition

delete2024-04-03
delete0
PRE
AI
Y
Yan-He Chen
M
Mei-Chen Yeh *
DOI:10.1007/s00530-024-01313-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Our paper addresses the challenge of generalized zero-shot learning, where the label of a target image may belong to either a seen or an unseen category. Previous methods for this task typically learn a joint embedding space where image features and their corresponding class prototypes are directly aligned. However, this can be difficult due to the inherent gap between the visual and semantic space. To overcome this challenge, we propose a novel learning framework that relaxes the alignment requirement. Our approach employs a metric learning-based loss function to optimize the visual embedding model, allowing for different penalty strengths on within-class and between-class similarities. By avoiding pair-wise comparisons between image and class embeddings, our approach achieves more flexibility in learning discriminative and generalized visual features. Our extensive experiments demonstrate the superiority of our method with performance on par with the state-of-the-art on five benchmarks.
Keyword:
Generalized zero-shot learning
Fine-grained visual recognition
Visual-semantic embedding
Deep metric learning

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

N
National Taiwan Normal University
学者数:
4.8K
论文数: 4.7K
被引数: 4.4K
引用论文

引用论文

err分享
err收藏
Robust Face Alignment by Multi-Order High-Precision Hourglass Network
err2021-01-01
err39
errOAAI
errWan, Jun; Lai, Zhihui; Liu, Jun; Zhou, Jie; Gao, Can
err分享
err收藏
Multi-level Feature Interaction and Efficient Non-Local Information Enhanced Channel Attention for image dehazing
err2023-06-01
err59
PREAI
errSun, Hang; Li, Bohui; Dan, Zhiping; Hu, Wei; Du, Bo; Yang, Wen; Wan, Jun
err分享
err收藏
err分享
err收藏
Fast Magic‐Angle‐Spinning NMR Reveals the Evasive Hepatitis B Virus Capsid C‐Terminal Domain**
err2022-06-24
err0
errOAAI
errMorgane Callon; Alexander A. Malär; Lauriane Lecoq; Marie Dujardin; Marie‐Laure Fogeron; Shishan Wang; Maarten Schledorn; Thomas Bauer; Michael Nassal; Anja Böckmann; Beat H. Meier
err分享
err收藏
Discriminative deep attributes for generalized zero-shot learning
err2022-04-01
err13
PREAI
errKim, Hoseong; Lee, Jewook; Byun, Hyeran
err分享
err收藏
Zero-Shot Image Classification Based on a Learnable Deep Metric基于可学习深度度量的零拍图像分类
errSENSORS
IF3.5
err2021-05-07
err7
errOAAI
errLiu, Jingyi; Shi, Caijuan; Tu, Dongjing; Shi, Ze; Liu, Yazhi
err分享
err收藏
学者 查看更多内容