Few-shot multi-view object classification via dual augmentation network

doi:10.1016/j.inffus.2023.101967

Few-shot multi-view object classification via dual augmentation network

2023-12-01

1

PRE

AI

DOI：10.1016/j.inffus.2023.101967

Original

Original request for help

Save

Abstract

En 中文

Existing multi-view object classification algorithms usually rely on sufficient labeled multi-view objects, which substantially restricts their scalability to novel classes with few annotated training samples in real-world applications. Aiming to go beyond these limitations, we explore a novel yet challenging task, few-shot multi -view object classification (FS-MVOC), which expects the network to build its classification ability efficiently based on limited labeled multi-view objects. To this end, we design a dual augmentation network (DANet) to provide excellent performance for the under-explored FS-MVOC task. On the one hand, we employ an attention -guided multi-view representation augmentation (AMRA) strategy to help the model focus on salient features and suppress unnecessary ones on multiple views of multi-view objects, resulting in more discriminative multi -view representations. On the other hand, during the meta-training stage, we adopt the category prototype augmentation (CPA) strategy to improve the class-representativeness of each prototype and increase the inter -prototype difference by injecting Gaussian noise in the deep feature space. Extensive experiments on the benchmark datasets (Meta-ModelNet and Meta-ShapeNet) indicate the effectiveness and robustness of DANet.

Keywords:

Multi-view object classification

Dual augmentation network

Few-shot learning

Few-shot multi-view object classification via dual augmentation network

Abstract

Journal

Organization