返回
Learning multi-tasks with inconsistent labels by using auxiliary big task
DOI:10.1007/s11704-022-2251-x.png)
摘要
En 中文
Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same, thus they can be utilized for learning across the tasks. However, the real world has more general scenarios in which each task has only a small number of training samples and their label sets are just partially overlapped or even not. Learning such MTs is more challenging because of less correlation information available among these tasks. For this, we propose a framework to learn these tasks by jointly leveraging both abundant information from a learnt auxiliary big task with sufficiently many classes to cover those of all these tasks and the information shared among those partially-overlapped tasks. In our implementation of using the same neural network architecture of the learnt auxiliary task to learn individual tasks, the key idea is to utilize available label information to adaptively prune the hidden layer neurons of the auxiliary network to construct corresponding network for each task, while accompanying a joint learning across individual tasks. Extensive experimental results demonstrate that our proposed method is significantly competitive compared to state-of-the-art methods.
Keyword:
multi-task learning
inconsistent labels
auxiliary task
期刊
IF:
4.6
论文数:
1.6K
被引数:
2.8K
机构
暂无机构信息
引用论文
Hypergraph based multi-task feature selection for multimodal classification of Alzheimer's disease基于超图的多任务特征选择在阿尔茨海默病多模态分类中的应用

