arrow
Return

Flexible latent variable models for multi-task learning

delete2008-04-02
delete70
delete
OA
AI
张剑 (Jian Zhang) *
Z
Zoubin Ghahramani
Y
Yiming Yang
DOI:10.1007/s10994-008-5050-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Given multiple prediction problems such as regression or classification, we are interested in a joint inference framework that can effectively share information between tasks to improve the prediction accuracy, especially when the number of training examples per problem is small. In this paper we propose a probabilistic framework which can support a set of latent variable models for different multi-task learning scenarios. We show that the framework is a generalization of standard learning methods for single prediction problems and it can effectively model the shared structure among different prediction tasks. Furthermore, we present efficient algorithms for the empirical Bayes method as well as point estimation. Our experiments on both simulated datasets and real world classification datasets show the effectiveness of the proposed models in two evaluation settings: a standard multi-task learning setting and a transfer learning setting.
Keywords:
Multi-task learning
Latent variable models
Hierarchical Bayesian models
Model selection
Transfer learning

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

Purdue University System cover
Purdue University System
Scholars:
3.9W
Papers: 3.6W
Citations: 66
U
University of Cambridge
Scholars:
7.7W
Papers: 7.1W
Citations: 13.7W
P
Purdue University
Scholars:
2.7W
Papers: 2.1W
Citations: 147
researcher View more organizations
Cited Papers

Cited Papers

Whisker-Reinforced Ceramic Matrix Composites
err2013-11-29
err0
PREAI
errJ. Homeny; W.L. Vaughn
errShare
errSave
PECVD-grown carbon nanotubes on silicon substrates with a nickel-seeded tip-growth structure
err2006-07-01
err0
PREAI
errY. Abdi; J. Koohsorkhi; J. Derakhshandeh; S. Mohajerzadeh; H. Hoseinzadegan; M.D. Robertson; J.C. Bennett; X. Wu; H. Radamson
errShare
errSave
Multitask learning
err1997-01-01
err4.9K
errOAAI
errCaruana, R
errShare
errSave
Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle Applications
err2017-07-25
err0
errOAAI
errMohan Krishna S.; Febin Daya J.L.; Sanjeevikumar Padmanaban; Lucian Mihet-Popa
errShare
errSave
PARS PLANA VITRECTOMY FOR PERSISTENT, VISUALLY SIGNIFICANT VITREOUS OPACITIES
err2000-01-01
err0
PREAI
errWILLIAM M. SCHIFF; STANLEY CHANG; NARESH MANDAVA; GAETANO R. BARILE
errShare
errSave
no more