arrow
返回

Fitting and sharing multi-task learning

delete2024-05-28
delete1
PRE
AI
C
Chengkai Piao *
卫
卫金茂 (Jinmao Wei)
DOI:10.1007/s10489-024-05549-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-Task Learning is an effective method for learning cross-task knowledge. However, existing methods cannot fairly treat each task, their public parts are prone to continuously fit new tasks and decrease the performances of previous tasks. In this paper, we propose the Fitting-sharing Multi-Task Learning method to address this problem. In the Fitting step, a group of indicator parameters are trained to extract task-specific features and store them into an in-task template matrix. After all models converge, the indicators and templates are frozen to protect the learned knowledge. In the Sharing step, a group of connector parameters are trained to acquire information from other templates and to reason cross-task knowledge. Since the learning and sharing processes are separate, each model can acquire the learned knowledge from other tasks without affect them, and the imbalanced cross-task knowledge problem can be naturally avoided. Experimental results on public datasets illustrate that the proposed method can insistently improve the performance compared with existing methods.
Keyword:
Fitting
Sharing
Parameter template
Multi-task learning

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
引用论文

引用论文

Elimination Strategy for Aromatic Acetylenes
err2006-08-26
err0
PREAI
errAkihiro Orita; Junzo Otera
err分享
err收藏
err分享
err收藏
Bilateral Emphysematous Pyelonephritis with a Splenic Abscess双侧大泡性肾盂肾炎伴脾脓肿
err2013-01-01
err0
errOAAI
errHiroshi Morioka; Naoki Yanagisawa; Akihiko Suganuma; Akifumi Imamura; Atsushi Ajisawa
err分享
err收藏
A Significant Influence of Metronidazole on Busulfan Pharmacokinetics: A Case Report of Therapeutic Drug Monitoring
err2017-06-01
err0
PREAI
errHyewon Chung; Kyung-Sang Yu; Kyung Taek Hong; Jung Yoon Choi; Che Ry Hong; Hyoung Jin Kang; Kyung Duk Park; Hee Young Shin; SeungHwan Lee
err分享
err收藏
RoFormer: Enhanced transformer with Rotary Position EmbeddingRoFormer: 带旋转位置嵌入的增强型变压器
err2024-02-01
err214
errOAAI
errSu, Jianlin; Ahmed, Murtadha; Lu, Yu; Pan, Shengfeng; Bo, Wen; Liu, Yunfeng
err分享
err收藏
学者 查看更多内容