arrow
返回

Decoder Choice Network for Metalearning

delete2023-06-01
delete2
delete
OA
AI
L
Liu, Jialin
F
Fei Chao *
L
Longzhi Yang
C
Chih‐Min Lin
C
Changjing Shang
Q
Qiang Shen
DOI:10.1109/TCYB.2021.3123403delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Metalearning has been widely applied for implementing few-shot learning and fast model adaptation. Particularly, existing metalearning methods have been exploited to learn the control mechanism for gradient descent processes, in an effort to facilitate gradient-based learning in gaining high speed and generalization ability. This article presents a novel method that controls the gradient descent process of the model parameters in a neural network, by limiting the model parameters within a low-dimensional latent space. The main challenge for implementing this idea is that a decoder with many parameters may be required. To tackle this problem, the article provides an alternative design of the decoder with a structure that shares certain weights, thereby reducing the number of required parameters. In addition, this work combines ensemble learning with the proposed approach to improve the overall learning performance. Systematic experimental studies demonstrate that the proposed approach offers results superior to the state of the art in performing the Omniglot classification and miniImageNet classification tasks.
Keyword:
Task analysis
Decoding
Training
Testing
Measurement
Optimization
Mathematical models
Decoder
ensemble learning
latent variable
metalearning

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

Y
yuan ze university
学者数:
3.0K
论文数: 3.4K
被引数: 3
N
Northumbria University
学者数:
5.6K
论文数: 6.8K
被引数: 9.5K
A
Aberystwyth University
学者数:
2.5K
论文数: 2.5K
被引数: 4.3K
X
xiamen university
学者数:
5.9W
论文数: 3.8W
被引数: 67
学者 查看更多机构
引用论文

引用论文

ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Synthesis of (+)‐Schisanwilsonene A by Tandem Gold‐Catalyzed Cyclization/1,5‐Migration/Cyclopropanation
err2013-05-10
err0
errOAAI
errMorgane Gaydou; Ricarda E. Miller; Nicolas Delpont; Julien Ceccon; Antonio M. Echavarren
err分享
err收藏
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
err2016-10-01
err1.7K
errOAAI
errZhang, Kaipeng; Zhang, Zhanpeng; Li, Zhifeng; Qiao, Yu
err分享
err收藏
err分享
err收藏
err分享
err收藏
A New Pimarane fromMitrephora Tomentosa
err2004-08-01
err0
PREAI
errButsarakham Supudompol; Tanawat Chaowasku; Kiattawon Kingfang; Kobkoon Burud; Sumphan Wongseripipatana; Kittisak Likhitwitayawuid
err分享
err收藏
学者 查看更多内容