.png){kind=icon}
返回
Learning to Compare Relation: Semantic Alignment for Few-Shot Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2022.3142530.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Few-shot learning is a fundamental and challenging problem since it requires recognizing novel categories from only a few examples. The objects for recognition have multiple variants and can locate anywhere in images. Directly comparing query images with example images can not handle content misalignment. The representation and metric for comparison are critical but challenging to learn due to the scarcity and wide variation of the samples in few-shot learning. In this paper, we present a novel semantic alignment model to compare relations, which is robust to content misalignment. We propose to add two key ingredients to existing few-shot learning frameworks for better feature and metric learning ability. First, we introduce a semantic alignment loss to align the relation statistics of the features from samples that belong to the same category. And second, local and global mutual information maximization is introduced, allowing for representations that contain locally-consistent and intra-class shared information across structural locations in an image. Furthermore, we introduce a principled approach to weigh multiple loss functions by considering the homoscedastic uncertainty of each stream. We conduct extensive experiments on several few-shot learning datasets. Experimental results show that the proposed method is capable of comparing relations with semantic alignment strategies, and achieves state-of-the-art performance.
Keyword:
Measurement
Streaming media
Task analysis
Semantics
Mutual information
Uncertainty
Feature extraction
Few-shot learning
relation modeling
semantic alignment
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
ARVino - outdoor augmented reality visualisation of viticulture GIS dataARVino-葡萄栽培GIS数据的户外增强现实可视化
OAAI
.png){kind=icon}
OAAI分享收藏分享收藏分享收藏
查看更多内容