.png){kind=icon}
Return
Robust Multitask Learning With Sample Gradient Similarity
.png){kind=icon}
PRE
AI
DOI：10.1109/TSMC.2023.3315541.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multitask learning has led to great success in many deep learning applications during the last decade. However, recent experiments have demonstrated that the performance of multitask learning depends on how to balance the relationship between different tasks. Therefore, many approaches have been proposed to adjust per-task gradient directions or design a more appropriate task reweighting scheme based on task-level statistics. In this article, we discuss how to boost the performance of multitask learning by using more fine-grained sample gradient information. To this end, we propose the concept of sample gradient similarity, which measures the agreement between the sample gradient for a task and the true gradient. Based on this concept, greater weight is assigned to more consistent tasks and more robust training samples to improve the training process of multitask learning. Extensive experimental results show that our proposed method outperforms the state-of-the-art algorithms on a series of challenging multitask datasets.
Keywords:
Deep learning
Automation
multitask learning
sample gradient
sample reweighting
task reweighting
Journal
IF:
10.5
Papers:
1.1W
Citations:
5.0W
Organization
View more organizations
Cited Papers
.png){kind=icon}
ShareSave
ShareSaveShareSaveShareSaveShareSaveAdversarial Learning and Self-Teaching Techniques for Domain Adaptation in Semantic Segmentation
OAAI
OAAIShareSave View more