.png){kind=icon}
Return
Multitask learning with single gradient step update for task balancing
.png){kind=icon}
OA
AI
DOI：10.1016/j.neucom.2021.10.025.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it can cause imbalance among tasks. To address the imbalance problem, we propose an algorithm to balance between tasks at the gradient level by applying gradient-based meta- learning to multitask learning. The proposed method trains shared layers and task-specific layers sepa-rately so that the two layers with different roles in a multitask network can be fitted to their own pur -poses. In particular, the shared layer that contains informative knowledge shared among tasks is trained by employing single gradient step update and inner/outer loop training to mitigate the imbalance problem at the gradient level. We apply the proposed method to various multitask computer vision prob-lems and achieve state-of-the-art performance. CO 2021 Elsevier B.V. All rights reserved.
Keywords:
Convolution neural network
Deep learning
Gradient-based meta learning
Multitask learning
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W
Organization
Cited Papers
ShareSaveElectrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV.png)
RSC Advances
RSC AdvancesIF0
PREAI
ShareSaveShareSaveRobust texture analysis of multi-modal images using Local Structure Preserving Ranklet and multi-task learning for breast tumor diagnosisNEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
ShareSaveShareSaveShareSave
ShareSaveShareSave
View more