arrow
Return

Geometry preserving multi-task metric learning

delete2013-05-25
delete35
PRE
AI
杨
杨沛沛 (Peipei Yang) *
K
Kaizhu Huang
刘
刘程琳 (Cheng‐Lin Liu)
DOI:10.1007/s10994-013-5379-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we consider the multi-task metric learning problem, i.e., the problem of learning multiple metrics from several correlated tasks simultaneously. Despite the importance, there are only a limited number of approaches in this field. While the existing methods often straightforwardly extend existing vector-based methods, we propose to couple multiple related metric learning tasks with the von Neumann divergence. On one hand, the novel regularized approach extends previous methods from the vector regularization to a general matrix regularization framework; on the other hand and more importantly, by exploiting von Neumann divergence as the regularization, the new multi-task metric learning method has the capability to well preserve the data geometry. This leads to more appropriate propagation of side-information among tasks and provides potential for further improving the performance. We propose the concept of geometry preserving probability and show that our framework encourages a higher geometry preserving probability in theory. In addition, our formulation proves to be jointly convex and the global optimal solution can be guaranteed. We have conducted extensive experiments on six data sets (across very different disciplines), and the results verify that our proposed approach can consistently outperform almost all the current methods.
Keywords:
Multi-task learning
Metric learning
Geometry preserving
von Neumann divergence
Bregman matrix divergence

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Crambin: a direct solution for a 400-atom structure
err1995-01-01
err0
PREAI
errC. M. Weeks; H. A. Hauptman; G. D. Smith; R. H. Blessing; M. M. Teeter; R. Miller
errShare
errSave
Immortalization of neuroendocrine pinealocytes from transgenic mice by targeted tumorigenesis using the tryptophan hydroxylase promoter
err1996-04-01
err0
errOAAI
errJin H. Son; Joo H. Chung; Sung O. Huh; Dong H. Park; C. Peng; M.G. Rosenblum; Young I. Chung; Tong H. Joh
errShare
errSave
2-D Material Molybdenum Disulfide Analyzed by XPS
err2014-07-09
err0
PREAI
errD. Ganta; S. Sinha; Richard T. Haasch
errShare
errSave
Guanosine 3′,5′-Monophosphate: A Central Nervous System Regulator of Analgesia
err1978-01-20
err0
PREAI
errMajor L. Cohn; Marthe Cohn; Floyd H. Taylor
errShare
errSave
Multitask learning
err1997-01-01
err4.9K
errOAAI
errCaruana, R
errShare
errSave
researcher View more