arrow
Return

Encoding sparse and competitive structures among tasks in multi-task learning

delete2019-04-01
delete4
PRE
AI
C
Cheng Liu *
C
Chu-Tao Zheng
S
Sheng Qian
吴
吴思 (Si Wu)
H
Hau−San Wong
DOI:10.1016/j.patcog.2018.12.018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-task learning (MTL) aims to enhance generalization performance by exploring the inherent structures across tasks. Most existing MTL methods are based on the assumption that the tasks are positively correlated, and utilize the shared structures among tasks to improve learning performance. By contrast, there also exist competitive structure (negative relationships) among tasks in some real-world applications, and conventional MTL methods which explore shared structures across tasks may lead to unsatisfactory performance in this setting. Another challenge, especially in a high dimensional setting, is to exclude irrelevant features (sparse structure) from the final model. For this purpose, this work propose a new method, which is referred to as Sparse Exclusive Lasso (SpEL) for multi-task learning. The proposed SpEL is able to capture the competitive relationship among tasks (competitive structure), while remove unimportant features which are common across the tasks from the final model (sparse structure). Experimental studies on synthetic and real data indicate that the proposed method can significantly improve learning performance by identifying sparse and task-competitive structures simultaneously. (C) 2018 Elsevier Ltd. All rights reserved.
Keywords:
Multi-task learning
Sparse exclusive lasso
Task-competitive
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Multi-task proximal support vector machine
err2015-10-01
err38
PREAI
errLi, Ya; Tian, Xinmei; Song, Mingli; Tao, Dacheng
errShare
errSave
Local structural change in GaCrN grown by radio frequency plasma-assisted molecular-beam epitaxy
err2004-12-01
err0
PREAI
errM. Hashimoto; H. Tanaka; S. Emura; M.S. Kim; T. Honma; N. Umesaki; Y.K. Zhou; S. Hasegawa; H. Asahi
errShare
errSave
errShare
errSave
Preservation of Putative Continence Nerves during Radical Retropubic Prostatectomy Leads to More Rapid Return of Urinary Continence
err1998-06-01
err0
PREAI
errRobert S Hollabaugh; Roger R Dmochowski; Timothy G Kneib; Mitchell S Steiner
errShare
errSave
Multitask learning
err1997-01-01
err4.9K
errOAAI
errCaruana, R
errShare
errSave
Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses
err2001-11-13
err2.3K
errOAAI
errBhattacharjee, A; Richards, WG; Staunton, J; Li, C; Monti, S; Vasa, P; Ladd, C; Beheshti, J; Bueno, R; Gillette, M; Loda, M; Weber, G; Mark, EJ; Lander, ES; Wong, W; Johnson, BE; Golub, TR; Sugarbaker, DJ; Meyerson, M
errShare
errSave
errShare
errSave
researcher View more