返回
Canonical mean filter for almost zero-shot multi-task classification
DOI:10.1007/s10489-023-04728-9.png)
摘要
En 中文
The support set plays a key role in providing conditional prior for fast adapting the feature extractors in few-shot tasks. The representative few-shot method CNAPs used a simple conditional feature encoder to extract the prior, which was a conditional feature of the task-specific support set. However, the strict form required by the support set makes its construction difficult in practical applications. Motivated by ANIL, we first investigate the role of the adaption in CNAPs by designing Almost Zero-Shot (AZS) tasks in which a fixed support set is used across all tasks instead of the task-specific support set. The AZS experimental results indicate that the adaptation contributes little to the feature extractor. Nevertheless, simply removing the adaptation from CNAPs will cause severe performance drop on some sub-datasets of the Meta-Dataset. To alleviate this problem, we further proposed a Canonical Mean Filter (CMF) module that maps any support set to a canonical form. The CMF yields a stable conditional feature, and hence allows for CNAPs to perform well without the conditional feature encoder and the parameter adaptation network at the test stage. CNAPs embedded with CMF significantly outperform the vanilla CNAPs for the AZS tasks, and even achieve comparable performance to one-shot tasks but with 40.48% parameter reduction and without task-specific support sets at the test stage.
Keyword:
Adaptation
Feature reuse
Support set
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
OCFSP: self-supervised one-class classification approach using feature-slide prediction subtask for feature data
SOFT COMPUTING
IF2.5
Developing Wind and/or Solar Powered Crop Irrigation Systems for the Great Plains为大平原开发风能和/或太阳能作物灌溉系统
Assessment of neurological manifestations in hospitalized patients with COVID‐19Covid-19住院患者神经系统表现的评估

