arrow
返回

Multi-Level Second-Order Few-Shot Learning

delete2023-01-01
delete21
delete
OA
AI
H
Hongguang Zhang *
H
Hongdong Li
P
Piotr Koniusz
DOI:10.1109/TMM.2022.3142955delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a Multi-level Second-order (MlSo) few-shot learning network for supervised or unsupervised few-shot image classification and few-shot action recognition. We leverage so-called power-normalized second-order base learner streams combined with features that express multiple levels of visual abstraction, and we use self-supervised discriminating mechanisms. As Second-order Pooling (SoP) is popular in image recognition, we employ its basic element-wise variant in our pipeline. The goal of multi-level feature design is to extract feature representations at different layer-wise levels of CNN, realizing several levels of visual abstraction to achieve robust few-shot learning. As SoP can handle convolutional feature maps of varying spatial sizes, we also introduce image inputs at multiple spatial scales into MlSo. To exploit the discriminative information from multi-level and multi-scale features, we develop a Feature Matching (FM) module that reweights their respective branches. We also introduce a self-supervised step, which is a discriminator of the spatial level and the scale of abstraction. Our pipeline is trained in an end-to-end manner. With a simple architecture, we demonstrate respectable results on standard datasets such as Omniglot, mini-ImageNet, tiered-ImageNet, Open MIC, fine-grained datasets such as CUB Birds, Stanford Dogs and Cars, and action recognition datasets such as HMDB51, UCF101, and mini-MIT.
Keyword:
Task analysis
Pipelines
Image recognition
Visualization
Feature extraction
Training
Streaming media
Few-shot learning
second-order statistics
image classification
action recognition

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

A
Australian National University
学者数:
2.1W
论文数: 2.3W
被引数: 3.9W
C
引用论文

引用论文

err分享
err收藏
Hepatocyte Polyploidy: Driver or Gatekeeper of Chronic Liver Diseases
err2021-10-14
err0
errOAAI
errRomain Donne; Flora Sangouard; Séverine Celton-Morizur; Chantal Desdouets
err分享
err收藏
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
err分享
err收藏
N-Doped Activated Carbons Derived from Biological Sludge Generated in Petrochemical Industries for Supercapacitor Applications
err2017-09-01
err0
PREAI
errXinyang Li; Lizheng Guo; Shaobin Sun; Xu Zhang; Guicheng Liu; Hong Yao; Mei Shi; Juan Li; Xin Yu; Shenghua Zhang
err分享
err收藏
学者 查看更多内容