ESSR: Evolving Sparse Sharing Representation for Multitask Learning

Yayu Zhang

doi:10.1109/TEVC.2023.3272663

ESSR: Evolving Sparse Sharing Representation for Multitask Learning

2024-06-01

2

PRE

AI

DOI：10.1109/TEVC.2023.3272663

Original

Original request for help

Save

Abstract

En 中文

Multitask learning (MTL) uses knowledge transfer among tasks to improve the generalization performance of all tasks. For deep MTL, knowledge transfer is often implemented via sharing all hidden features of tasks. A major shortcoming is that it can lead to negative knowledge transfer across tasks when task correlation is weak. To overcome it, this article proposes an evolutionary method to learn sparse sharing representations adaptively. By embedding the neural network optimization into evolutionary multitasking, our proposed method finds an optimal combination of tasks and sharing features. It can identify negative correlation and redundant features and then remove them from the hidden feature set. Thus, an optimal sparse sharing subnetwork can be produced for each task. Experiment results show that the proposed method achieve better learning performance with a smaller inference model than other related methods.

Keywords:

Task analysis

Multitasking

Adaptation models

Optimization

Knowledge transfer

Correlation

Training

Evolutionary multitasking optimization

knowledge transfer

multitask learning (MTL)

sharing representation

ESSR: Evolving Sparse Sharing Representation for Multitask Learning

Abstract

Journal

Organization