arrow
Return

Model-agnostic multi-stage loss optimization meta learning

delete2021-04-26
delete7
PRE
AI
X
Xiao Yao
J
Jianlong Zhu
G
Guanying Huo *
N
Ning Xu
X
Xiaofeng Liu
C
Ce Zhang
DOI:10.1007/s13042-021-01316-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Model Agnostic Meta Learning (MAML) has become the most representative meta learning algorithm to solve few-shot learning problems. This paper mainly discusses MAML framework, focusing on the key problem of solving few-shot learning through meta learning. However, MAML is sensitive to the base model for the inner loop, and training instability occur during the training process, resulting in an increase of the training difficulty of the model in the process of training and verification process, causing degradation of model performance. In order to solve these problems, we propose a multi-stage loss optimization meta-learning algorithm. By discussing a learning mechanism for inner and outer loops, it improves the training stability and accelerates the convergence for the model. The generalization ability of MAML has been enhanced.
Keywords:
Meta learning
Few-shot learning
Training instability
Multi-stage loss optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Machine Learning and Cybernetics cover
International Journal of Machine Learning and Cybernetics
IF:
2.7
Papers:
3.1K
Citations:
5.6K

Organization

H
Hohai University
Scholars:
2.3W
Papers: 1.8W
Citations: 2.1W