Enhancing semi-supervised learning through label-aware base kernels

Qiaojun Wang

doi:10.1016/j.neucom.2015.07.072

Return

Enhancing semi-supervised learning through label-aware base kernels

2016-01-01

PRE

DOI：10.1016/j.neucom.2015.07.072

Original

Original request for help

Save

Abstract

En 中文

Currently, a large family of kernel design methods for semi-supervised learning (SSL) problems builds the kernel by weighted averaging of predefined base kernels (i.e., those spanned by kernel eigenvectors). Optimization of the base kernel weights has been studied extensively in the literature. However, little attention was devoted to designing high-quality base kernels. The eigenvectors of the kernel matrix, which are computed irrespective of class labels, may not always reveal useful structures of the target. As a result, the generalization performance can be poor however hard the base kernel weighting is tuned. On the other hand, there are many SSL algorithms whose focus are not on kernel design but on the estimation of the class labels directly. Motivated by the label propagation approach, in this paper we propose to construct novel kernel eigenvectors by injecting the class label information under the framework of eigenfunction extrapolation. A set of label-aware base kernels can be obtained with greatly improved quality, which leads to higher target alignment and henceforth better performance. Our approach is computationally efficient, and demonstrates encouraging performance in semi-supervised classification and regression tasks. (C) 2015 Elsevier B.V. All rights reserved.

Keywords:

Semi-supervised learning

Multiple-kernel learning

Kernel target alignment

Label-aware base kernels