arrow
返回

Episodic task agnostic contrastive training for multi-task learning?

delete2023-05-01
delete6
PRE
AI
周
周帆 (Fan Zhou)
Y
Yuyi Chen
J
Jun Wen
Q
Qiuhao Zeng
C
Changjian Shui
C
Charles X. Ling
S
Shichun Yang *
B
Boyu Wang *
DOI:10.1016/j.neunet.2023.02.023delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Learning knowledge from different tasks to improve the general learning performance is crucial for designing an efficient algorithm. In this work, we tackle the Multi-task Learning (MTL) problem, where the learner extracts the knowledge from different tasks simultaneously with limited data. Previous works have been designing the MTL models by taking advantage of the transfer learning techniques, requiring the knowledge of the task index, which is not realistic in many practical scenarios. In contrast, we consider the scenario that the task index is not explicitly known, under which the features extracted by the neural networks are task agnostic. To learn the task agnostic invariant features, we implement model agnostic meta-learning by leveraging the episodic training scheme to capture the common features across tasks. Apart from the episodic training scheme, we further implemented a contrastive learning objective to improve the feature compactness for a better prediction boundary in the embedding space. We conduct extensive experiments on several benchmarks compared with several recent strong baselines to demonstrate the effectiveness of the proposed method. The results showed that our method provides a practical solution for real-world scenarios, where the task index is agnostic to the learner and can outperform several strong baselines, achieving state-of-the-art performances.(c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Multi-task learning
Meta learning
Contrastive learning

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

W
western university (university of western ontario)
学者数:
2.9W
论文数: 2.7W
被引数: 33
H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
H
Harvard Medical School
学者数:
6.5W
论文数: 4.8W
被引数: 91
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
The orthologous Tbx transcription factors Omb and TBX2 induce epithelial cell migration and extrusionin vivowithout involvement of matrix metalloproteinases
err2014-09-02
err0
errOAAI
errJie Shen; Juan Lu; Liyuan Sui; Dan Wang; Meizhen Yin; Inka Hoffmann; Anne Legler; Gert O. Pflugfelder
err分享
err收藏
err分享
err收藏
err分享
err收藏
Students’ attitudes toward digital learning during the COVID-19 pandemic: a survey conducted following an online course in gynecology and obstetrics
err2021-08-05
err0
errOAAI
errGregor Leonhard Olmes; Julia Sarah Maria Zimmermann; Lisa Stotz; Ferenc Zoltan Takacs; Amr Hamza; Marc Philipp Radosa; Sebastian Findeklee; Erich-Franz Solomayer; Julia Caroline Radosa
err分享
err收藏
学者 查看更多内容