arrow
Return

Approximate Kernel Selection via Matrix Approximation

delete2020-11-01
delete13
delete
OA
AI
丁立中 cover
丁立中 (Lizhong Ding)
S
Shizhong Liao
刘勇 (Yong Liu)
L
Li Liu
F
Fan Zhu
Y
Yazhou Yao
L
Ling Shao
高欣 (Xin Gao) *
DOI:10.1109/TNNLS.2019.2958922delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Kernel selection is of fundamental importance for the generalization of kernel methods. This article proposes an approximate approach for kernel selection by exploiting the approximability of kernel selection and the computational virtue of kernel matrix approximation. We define approximate consistency to measure the approximability of the kernel selection problem. Based on the analysis of approximate consistency, we solve the theoretical problem of whether, under what conditions, and at what speed, the approximate criterion is close to the accurate one, establishing the foundations of approximate kernel selection. We introduce two selection criteria based on error estimation and prove the approximate consistency of the multilevel circulant matrix (MCM) approximation and Nystr m approximation under these criteria. Under the theoretical guarantees of the approximate consistency, we design approximate algorithms for kernel selection, which exploits the computational advantages of the MCM and Nystr m approximations to conduct kernel selection in a linear or quasi-linear complexity. We experimentally validate the theoretical results for the approximate consistency and evaluate the effectiveness of the proposed kernel selection algorithms.
Keywords:
Kernel
Approximation algorithms
Complexity theory
Matrix decomposition
Task analysis
Learning systems
Error analysis
Approximate algorithms
approximate consistency
kernel matrix approximation
kernel selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

K
king abdullah university of science & technology
Scholars:
1.3W
Papers: 1.3W
Citations: 32
T
tianjin university
Scholars:
7.9W
Papers: 5.7W
Citations: 88
I
institute of information engineering, cas
Scholars:
474
Papers: 466
Citations: 0
C
chinese academy of sciences
Scholars:
56.0W
Papers: 44.8W
Citations: 704
researcher View more organizations