.png){kind=icon}
返回
ESSR: Evolving Sparse Sharing Representation for Multitask Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TEVC.2023.3272663.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multitask learning (MTL) uses knowledge transfer among tasks to improve the generalization performance of all tasks. For deep MTL, knowledge transfer is often implemented via sharing all hidden features of tasks. A major shortcoming is that it can lead to negative knowledge transfer across tasks when task correlation is weak. To overcome it, this article proposes an evolutionary method to learn sparse sharing representations adaptively. By embedding the neural network optimization into evolutionary multitasking, our proposed method finds an optimal combination of tasks and sharing features. It can identify negative correlation and redundant features and then remove them from the hidden feature set. Thus, an optimal sparse sharing subnetwork can be produced for each task. Experiment results show that the proposed method achieve better learning performance with a smaller inference model than other related methods.
Keyword:
Task analysis
Multitasking
Adaptation models
Optimization
Knowledge transfer
Correlation
Training
Evolutionary multitasking optimization
knowledge transfer
multitask learning (MTL)
sharing representation
期刊
IF:
12
论文数:
1.9K
被引数:
2.6W
机构
引用论文
.png){kind=icon}
查看更多内容