Max-margin embedding for multi-label learning

doi:10.1016/j.patrec.2012.10.016

Max-margin embedding for multi-label learning

2013-02-01

11

PRE

AI

DOI：10.1016/j.patrec.2012.10.016

Original

Original request for help

Save

Abstract

En 中文

Multi-label learning refers to methods for learning a classification function that predicts a set of relevant labels for an instance. Label embedding seeks a transformation which maps labels into a latent space where regression is performed to predict a set of relevant labels. The latent space is often a low-dimensional space, so computational and space complexities are reduced. However, the choice of an appropriate transformation to a latent space is not clear. In this paper we present a max-margin embedding method where both instances and labels are mapped into a low-dimensional latent space. In contrast to existing label embedding methods, the pair of instance and label embeddings is determined by minimizing a cost-sensitive multi-label hinge loss, in which label-dependent cost is applied to more penalize the misclassification of positive examples. For implementation, we employ the limited memory Broyden-Fletcher-Goldfarb-Shanno (BEGS) method to determine the instance and label embeddings by a joint optimization. Numerical experiments on a few datasets demonstrate the high performance of our method compared to existing embedding methods in the case where the dimensionality of the latent space is much smaller than that of the original label space. (C) 2012 Elsevier B.V. All rights reserved.

Keywords:

Multi-label learning

Label embedding

Max-margin learning

Cost-sensitive multi-label hinge loss

One versus all (OVA)

Max-margin embedding for multi-label learning

Abstract

Journal

Organization