Semantic-Based Implicit Feature Transform for Few-Shot Classification

Mei-Hong Pan

doi:10.1007/s11263-024-02113-8

Semantic-Based Implicit Feature Transform for Few-Shot Classification

2024-05-30

2

PRE

AI

DOI：10.1007/s11263-024-02113-8

Original

Original request for help

Save

Abstract

En 中文

Few-shot learning aims to recognize instances from previously unseen classes based on a very limited number of examples. However, models often face the challenge of overfitting due to the biased distribution computed from extremely scarce training data. This work proposes a Semantic-based Implicit Feature Transform (SIFT) method to implicitly generate high-quality features for few-shot learning tasks. In this method, we employ an encode-transform-decode pipeline to facilitate the direct transfer of feature instances from base classes to novel classes via semantic transformation, ensuring the generation of semantically meaningful features. Additionally, a compactness constraint is imposed on the generated features, with novel class prototypes serving as anchors, to ensure that the features are distributed around the class centers. Furthermore, we integrate the cluster centers of the query set with the initial prototypes computed from the support set to produce less biased class prototypes, which can serve as better anchors for feature reconstruction. The experimental results reveal that our method outperforms the baselines by substantial margins and achieves state-of-the-art few-shot classification performance on the miniImageNet and CIFAR-FS datasets in both inductive and transductive settings, demonstrating the superiority of our method. Furthermore, the comprehensive ablation studies provide additional validation of its effectiveness. The code is available at: https://github.com/pmhDL/SIFT.git.

Keywords:

Implicit feature transform

Tied weight

Cluster assignments

Path planning problem

Semantic-Based Implicit Feature Transform for Few-Shot Classification

Abstract

Journal

Organization