arrow
返回

Learning multi-tasks with inconsistent labels by using auxiliary big task

delete2023-02-22
delete3
PRE
AI
Songcan Chen 封面图
Songcan Chen (Songcan Chen) *
DOI:10.1007/s11704-022-2251-xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same, thus they can be utilized for learning across the tasks. However, the real world has more general scenarios in which each task has only a small number of training samples and their label sets are just partially overlapped or even not. Learning such MTs is more challenging because of less correlation information available among these tasks. For this, we propose a framework to learn these tasks by jointly leveraging both abundant information from a learnt auxiliary big task with sufficiently many classes to cover those of all these tasks and the information shared among those partially-overlapped tasks. In our implementation of using the same neural network architecture of the learnt auxiliary task to learn individual tasks, the key idea is to utilize available label information to adaptively prune the hidden layer neurons of the auxiliary network to construct corresponding network for each task, while accompanying a joint learning across individual tasks. Extensive experimental results demonstrate that our proposed method is significantly competitive compared to state-of-the-art methods.
Keyword:
multi-task learning
inconsistent labels
auxiliary task

期刊

Frontiers of Computer Science 封面图
Frontiers of Computer Science
IF:
4.6
论文数:
1.6K
被引数:
2.8K

机构

暂无机构信息
引用论文

引用论文

Annual Effects of Different Organic Fertilisers in a Baby Leaf Crops System Under Tunnel in Southern Italy
err2015-01-01
err0
errOAAI
errLuigi Morra; Maurizio Bilotto; Salvatore Baiano; Giovanni Saviello; Domenico Cerrato
err分享
err收藏
Novel synthesis of α-galactosyl-ceramides and confirmation of their powerful NKT cell agonist activity
err2006-12-01
err0
PREAI
errAdrianne Lee; Kathryn J. Farrand; Nina Dickgreber; Colin M. Hayman; Stefan Jürs; Ian F. Hermans; Gavin F. Painter
err分享
err收藏
Hybrid -task learning for robust automatic speech recognition
err2020-11-01
err17
PREAI
errPironkov, Gueorgui; Wood, Sean U. N.; Dupont, Stephane
err分享
err收藏
学者 查看更多内容