.png){kind=icon}
返回
Multitask learning with single gradient step update for task balancing
.png){kind=icon}
OA
AI
DOI：10.1016/j.neucom.2021.10.025.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it can cause imbalance among tasks. To address the imbalance problem, we propose an algorithm to balance between tasks at the gradient level by applying gradient-based meta- learning to multitask learning. The proposed method trains shared layers and task-specific layers sepa-rately so that the two layers with different roles in a multitask network can be fitted to their own pur -poses. In particular, the shared layer that contains informative knowledge shared among tasks is trained by employing single gradient step update and inner/outer loop training to mitigate the imbalance problem at the gradient level. We apply the proposed method to various multitask computer vision prob-lems and achieve state-of-the-art performance. CO 2021 Elsevier B.V. All rights reserved.
Keyword:
Convolution neural network
Deep learning
Gradient-based meta learning
Multitask learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏Robust texture analysis of multi-modal images using Local Structure Preserving Ranklet and multi-task learning for breast tumor diagnosisNEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏
分享收藏分享收藏
查看更多内容