.png){kind=icon}
Return
Variable multi-scale attention fusion network and adaptive correcting gradient optimization for multi-task learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2025.111423.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Network architecture and optimization are two indispensable parts in multi-task learning, which together improve the performance of multi-task learning. Previous work has rarely focused on both aspects simultaneously. In this paper, we analyze the multi-task learning from network architecture and optimization. In network architecture aspect, we propose a variable multi-scale attention fusion network, which overcomes the issue of feature loss when processing small-scale feature maps during upsampling and resolves the problem of inadequate learning in conventional multi-scale models due to significant spatial size disparities. In optimization aspect, a adaptive correcting gradient scheme is put forward to treat the defects of conflicts and dominance among multiple tasks during the process of training, and it effectively alleviates the imbalance of multi-task training. Various ablation experiments and comparative experiments demonstrate that simultaneously considering the network framework and optimization can make great improvement for the performance of multi-task learning. Our code is available at https://github.com/SyqxhSt/Net-Opt-MTL
Keywords:
Multi-task learning
Network architecture
Optimization
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
COVID-MTL: Multitask learning with Shift3D and random-weighted loss for COVID-19 diagnosis and severity assessment.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAIShareSaveShareSaveShareSaveShareSaveShareSaveTask weighting based on particle filter in deep multi-task learning with a view to uncertainty and performancePATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveRobust visual tracking by embedding combination and weighted-gradient optimizationPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveMulti-task learning based on geometric invariance discriminative featuresAPPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
ShareSave
View more