arrow
Return

Eigenfunction-Based Multitask Learning in a Reproducing Kernel Hilbert Space

delete2019-06-01
delete14
PRE
AI
X
Xinmei Tian *
Y
Ya Li
Tongliang Liu cover
Tongliang Liu (Tongliang Liu)
X
Xinchao Wang
D
Dacheng Tao
DOI:10.1109/TNNLS.2018.2873649delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multitask learning aims to improve the performance on related tasks by exploring the interdependence among them. Existing multitask learning methods explore the relatedness among tasks on the basis of the input features and the model parameters. In this paper, we focus on nonparametric multitask learning and propose to measure task relatedness from a novel perspective in a reproducing kernel Hilbert space (RKHS). Past works have shown that the objective function for a given task can be approximated using the top eigenvalues and corresponding eigenfunctions of a predefined integral operator on an RKHS. In our method, we formulate our objective for multitask learning as a linear combination of two sets of eigenfunctions, common eigenfunctions shared by different tasks and unique eigenfunctions in individual tasks, such that the eigenfunctions for one task can provide additional information on another and help to improve its performance. We present both theoretical and empirical validations of our proposed approach. The theoretical analysis demonstrates that our learning algorithm is uniformly argument stable and that the convergence rate of the generalization upper bound can be improved by learning multiple tasks. Experiments on several benchmark multitask learning data sets show that our method yields promising results.
Keywords:
Eigenfunction-based learning
multitask learning
regression
task relatedness
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

U
University of Sydney
Scholars:
6.5W
Papers: 6.2W
Citations: 90
U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Polypropylene/graphene nanosheet nanocomposites by in situ polymerization: Synthesis, characterization and fundamental properties
err2013-07-01
err0
PREAI
errMarcéo A. Milani; Darío González; Raúl Quijada; Nara R.S. Basso; Maria L. Cerrada; Denise S. Azambuja; Griselda B. Galland
errShare
errSave
Multi-task proximal support vector machine
err2015-10-01
err38
PREAI
errLi, Ya; Tian, Xinmei; Song, Mingli; Tao, Dacheng
errShare
errSave
errShare
errSave
errShare
errSave
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
errShare
errSave
Catalytic activity and mechanism of typical iron-based catalysts for Fenton-like oxidation
err2023-01-01
err0
PREAI
errXiaochen Liu; Yuan Yao; Jun Lu; Juan Zhou; Quanyuan Chen
errShare
errSave
researcher View more