arrow
Return

Predictive Nystrom method for kernel methods

delete2017-04-01
delete7
PRE
AI
J
Jiangang Wu
丁立中 cover
丁立中 (Lizhong Ding)
S
Shizhong Liao *
DOI:10.1016/j.neucom.2016.12.047delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Nystrom method is a widely used matrix approximation method for scaling up kernel methods, and existing sampling strategies for Nystrom method are proposed to improve the matrix approximation accuracy, but leaving approximation independent of learning, which can result in poor predictive performance of kernel methods. In this paper, we propose a novel predictive sampling strategy (PRESS) for Nystrom method that guarantees the predictive performance of kernel methods. PRESS adaptively updates the sampling distribution via the discrepancy between approximate and accurate solutions of kernel methods caused by kernel matrix approximation, and samples informative columns from the kernel matrix according to the sampling distribution to reduce the predictive performance loss of kernel methods. We prove upper error bounds on the approximate solutions of kernel methods produced by Nystrom method with PRESS, whose convergence shows that approximate solutions of kernel methods are identical to accurate ones for large enough samples. Experimental results indicate that integrating learning into approximation is necessary for delivering better predictive performance, and PRESS significantly outperforms existing sampling strategies while preserving low computational cost.
Keywords:
Nystrom method
Matrix approximation
Kernel methods
Predictive sampling strategy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
Cited Papers

Cited Papers

Multi‐Stimuli‐Induced Mechanical Bending and Reversible Fluorescence Switching in a Single Organic Crystal
err2021-11-22
err0
PREAI
errXin Zheng; Xiaojing Liu; Lijie Liu; Xiaochuan Li; Song Jiang; Caoyuan Niu; Puhui Xie; Guoxing Liu; Zhanqi Cao; Yunlai Ren; Yuchen Qin; Jianji Wang
errShare
errSave
errShare
errSave
Solution structure of 5-keto-D-fructose: relevance to the specificity of hexose kinases
err2002-05-01
err0
PREAI
errJohn S. Blanchard; C. F. Brewer; Sasha Englard; Gad Avigad
errShare
errSave
The comparison of knee osteoarthritis treatment with single-dose bone marrow-derived mononuclear cells vs. hyaluronic acid injections
err2017-01-01
err0
errOAAI
errValdis Goncars; Eriks Jakobsons; Kristaps Blums; Ieva Briede; Liene Patetko; Kristaps Erglis; Martins Erglis; Konstantins Kalnberzs; Indrikis Muiznieks; Andrejs Erglis
errShare
errSave
errShare
errSave
err1999-01-01
err0
PREAI
errJ.A.K. Suykens; J. Vandewalle
errShare
errSave
researcher View more