arrow
返回

Canonical mean filter for almost zero-shot multi-task classification

delete2023-07-25
delete0
PRE
AI
Y
Yong Li
H
Heng Wang *
X
Xiang Ye
DOI:10.1007/s10489-023-04728-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The support set plays a key role in providing conditional prior for fast adapting the feature extractors in few-shot tasks. The representative few-shot method CNAPs used a simple conditional feature encoder to extract the prior, which was a conditional feature of the task-specific support set. However, the strict form required by the support set makes its construction difficult in practical applications. Motivated by ANIL, we first investigate the role of the adaption in CNAPs by designing Almost Zero-Shot (AZS) tasks in which a fixed support set is used across all tasks instead of the task-specific support set. The AZS experimental results indicate that the adaptation contributes little to the feature extractor. Nevertheless, simply removing the adaptation from CNAPs will cause severe performance drop on some sub-datasets of the Meta-Dataset. To alleviate this problem, we further proposed a Canonical Mean Filter (CMF) module that maps any support set to a canonical form. The CMF yields a stable conditional feature, and hence allows for CNAPs to perform well without the conditional feature encoder and the parameter adaptation network at the test stage. CNAPs embedded with CMF significantly outperform the vanilla CNAPs for the AZS tasks, and even achieve comparable performance to one-shot tasks but with 40.48% parameter reduction and without task-specific support sets at the test stage.
Keyword:
Adaptation
Feature reuse
Support set

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
引用论文

引用论文

Long-Term Longitudinal Patterns of Patient-Reported Fatigue After Breast Cancer: A Group-Based Trajectory Analysis
err2022-07-01
err0
errOAAI
errInes Vaz-Luis; Antonio Di Meglio; Julie Havas; Mayssam El-Mouhebb; Pietro Lapidari; Daniele Presti; Davide Soldato; Barbara Pistilli; Agnes Dumas; Gwenn Menvielle; Cecile Charles; Sibille Everhard; Anne-Laure Martin; Paul H. Cottu; Florence Lerebours; Charles Coutant; Sarah Dauchy; Suzette Delaloge; Nancy U. Lin; Patricia A. Ganz; Ann H. Partridge; Fabrice André; Stefan Michiels
err分享
err收藏
err分享
err收藏
Influence of the Heating Rate on the Foaming Behavior of Various Aluminium Alloys
err2017-08-23
err0
errOAAI
errTillmann Neu; Beate Pfretzschner; Francisco García-Moreno; John Banhart
err分享
err收藏
Comparison of Chlorophyll and Carotenoid Concentrations Among Russian Wheat Aphid (Homoptera: Aphididae)-Infested Wheat Isolines
err2003-04-01
err0
errOAAI
errT. M. Heng-Moss; X. Ni; T. Macedo; J. P. Markwell; F. P. Baxendale; S. S. Quisenberry; V. Tolmay
err分享
err收藏
Assessment of neurological manifestations in hospitalized patients with COVID‐19Covid-19住院患者神经系统表现的评估
err2020-08-24
err0
errOAAI
errM. Luigetti; R. Iorio; A. R. Bentivoglio; L. Tricoli; V. Riso; J. Marotta; C. Piano; G. Primiano; L. Zileri Del Verme; M. R. Lo Monaco; P. Calabresi
err分享
err收藏
学者 查看更多内容