.png){kind=icon}
Return
Resource-Efficient Multi-Task Deep Learning Using a Multi-Path Network
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3161622.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multi-task learning (MTL) improves learning efficiency compared to the single-task counterpart in that it performs multiple tasks at the same time. Due to the nature, it can achieve generalized performance as well as alleviate overfitting. However, it does not efficiently perform resource-aware inference from a single trained architecture. To address the issue, we aim to build a learning framework that minimizes the cost to infer tasks under different memory budgets. To this end, we propose a multi-path network with a self-auxiliary learning strategy. The multi-path structure contains task-specific paths in a backbone network, where a lower-level path predicts earlier with a smaller number of parameters. To alleviate the performance degradation from earlier predictions, a self-auxiliary learning strategy is presented. The self-auxiliary tasks convey task-specific knowledge to the main tasks to compensate for the performance leak. We evaluate the proposed method on an extensive set of multi-task learning scenarios, including multiple tasks learning, hierarchical learning, and curriculum learning. The proposed method outperforms existing multi-task learning competitors for most scenarios about by a margin of 1% similar to 2% accuracy on average while consuming 30% similar to 60% smaller computational cost.
Keywords:
Multi-task learning
resource-efficient learning
multi-path network
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
Organization
Cited Papers
ShareSaveTumour‐associated changes in intestinal epithelial cells cause local accumulation of KLRG1+GATA3+ regulatory T cells in mice.png)
Immunology
OAAI
ImmunologyIF0
OAAIShareSaveShareSaveShareSaveCharacterizing Tourism Destination and Policies Forward: The Case in Bantayan Island, Philippines
PREAI
ShareSaveShareSaveMitochondrial Dynamics Associated with Oxygen-Glucose Deprivation in Rat Primary Neuronal CulturesPLoS ONEOAAI
PLoS ONEIF0
OAAIShareSave
View more