.png){kind=icon}
返回
STG-MTL: scalable task grouping for multi-task learning using data maps
.png){kind=icon}
OA
AI
DOI：10.1088/2632-2153/ad4e04.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-Task Learning (MTL) is a powerful technique that has gained popularity due to its performance improvement over traditional Single-Task Learning (STL). However, MTL is often challenging because there is an exponential number of possible task groupings, which can make it difficult to choose the best one because some groupings might produce performance degradation due to negative interference between tasks. That is why existing solutions are severely suffering from scalability issues, limiting any practical application. In our paper, we propose a new data-driven method that addresses these challenges and provides a scalable and modular solution for classification task grouping based on a re-proposed data-driven features, Data Maps, which capture the training dynamics for each classification task during the MTL training. Through a theoretical comparison with other techniques, we manage to show that our approach has the superior scalability. Our experiments show a better performance and verify the method's effectiveness, even on an unprecedented number of tasks (up to 100 tasks on CIFAR100). Being the first to work on such number of tasks, our comparisons on the resulting grouping shows similar grouping to the mentioned in the dataset, CIFAR100. Finally, we provide a modular implementation 3 3 https://github.com/ammarSherif/STG-MTL. for easier integration and testing, with examples from multiple datasets and tasks.
Keyword:
STG-MTL
multi-task learning
MTL
task grouping
scalability
data-driven
期刊
M
IF:
4.6
论文数:
1.1K
被引数:
3.4K
机构
引用论文
COVID-MTL: Multitask learning with Shift3D and random-weighted loss for COVID-19 diagnosis and severity assessmentCovid-mtl: 具有Shift3D和随机加权损失的多任务学习，用于新型冠状病毒肺炎诊断和严重程度评估.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏Distilling sub-space structure across views for cardiac indices estimationMEDICAL IMAGE ANALYSIS
MEDICAL IMAGE ANALYSISIF11.8
PREAI
分享收藏分享收藏ST-MTL: Spatio-Temporal multitask learning model to predict scanpath while tracking instruments in robotic surgeryMEDICAL IMAGE ANALYSISOAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏
查看更多内容