arrow
Return

Multi-Level Second-Order Few-Shot Learning

delete2023-01-01
delete21
delete
OA
AI
H
Hongguang Zhang *
H
Hongdong Li
P
Piotr Koniusz
DOI:10.1109/TMM.2022.3142955delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a Multi-level Second-order (MlSo) few-shot learning network for supervised or unsupervised few-shot image classification and few-shot action recognition. We leverage so-called power-normalized second-order base learner streams combined with features that express multiple levels of visual abstraction, and we use self-supervised discriminating mechanisms. As Second-order Pooling (SoP) is popular in image recognition, we employ its basic element-wise variant in our pipeline. The goal of multi-level feature design is to extract feature representations at different layer-wise levels of CNN, realizing several levels of visual abstraction to achieve robust few-shot learning. As SoP can handle convolutional feature maps of varying spatial sizes, we also introduce image inputs at multiple spatial scales into MlSo. To exploit the discriminative information from multi-level and multi-scale features, we develop a Feature Matching (FM) module that reweights their respective branches. We also introduce a self-supervised step, which is a discriminator of the spatial level and the scale of abstraction. Our pipeline is trained in an end-to-end manner. With a simple architecture, we demonstrate respectable results on standard datasets such as Omniglot, mini-ImageNet, tiered-ImageNet, Open MIC, fine-grained datasets such as CUB Birds, Stanford Dogs and Cars, and action recognition datasets such as HMDB51, UCF101, and mini-MIT.
Keywords:
Task analysis
Pipelines
Image recognition
Visualization
Feature extraction
Training
Streaming media
Few-shot learning
second-order statistics
image classification
action recognition

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

A
Australian National University
Scholars:
2.1W
Papers: 2.3W
Citations: 3.9W
Cited Papers

Cited Papers

errShare
errSave
Hepatocyte Polyploidy: Driver or Gatekeeper of Chronic Liver Diseases
err2021-10-14
err0
errOAAI
errRomain Donne; Flora Sangouard; Séverine Celton-Morizur; Chantal Desdouets
errShare
errSave
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
errShare
errSave
N-Doped Activated Carbons Derived from Biological Sludge Generated in Petrochemical Industries for Supercapacitor Applications
err2017-09-01
err0
PREAI
errXinyang Li; Lizheng Guo; Shaobin Sun; Xu Zhang; Guicheng Liu; Hong Yao; Mei Shi; Juan Li; Xin Yu; Shenghua Zhang
errShare
errSave
researcher View more