arrow
Return

Kernel-target alignment based non-linear metric learning

delete2020-10-01
delete3
PRE
AI
Y
Yonghui Xu
C
Chunyan Miao *
Y
Yong Liu
宋恒杰 cover
宋恒杰 (Hengjie Song) *
Y
Yi Hu
H
Huaqing Min
DOI:10.1016/j.neucom.2020.06.042delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distance metric learning aims to learn a measure of the pairwise distance between data instances, which is essential for various machine learning algorithms and applications. However, existing linear metric learning methods based on linear transformations fail to capture nonlinear relationships between instances, while most existing kernel-based metric learning algorithms may ignore the correlation between the kernel function and the target learning task during model selection, which results in a suboptimal selection of kernels. To address the aforementioned issues, we propose a method named Kernel Alignment based Metric Learning with Random Fourier Approximation (KAML(RFA)). Specifically, on one hand, we utilize the random Fourier features to approximate the shift-invariant kernel function for distance metric learning. On the other hand, we attempt to maximize the degree of agreement between the kernel function and the target learning task. In this way, distance metric learning is performed in a discriminative feature space. Compared with those kernel metric learning algorithms whose kernel functions fall into a suboptimal, KAML(RFA) achieves the optimal kernel function for the target task and improves classification accuracy. We develop an efficient solution to solve the proposed optimization problem. Extensive experiments are conducted on several benchmark datasets including NUS-WIDE-LITE, USPS, MNIST, LETTER and 10 UCI datasets to verify the effectiveness of KAML(RFA) compared with state-of-the-art methods. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Metric learning
Learning framework
Random Fourier Approximation
Kernel-target alignment
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

A
alibaba group
Scholars:
1.1K
Papers: 789
Citations: 0
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
S
south china university of technology
Scholars:
6.7W
Papers: 5.1W
Citations: 85
researcher View more organizations