arrow
返回

Large-Scale Nystrom Kernel Matrix Approximation Using Randomized SVD

delete2015-01-01
delete89
PRE
AI
李
李穆 (Mu Li) *
W
Wei Bi
J
James T. Kwok
B
Bao‐Liang Lu
DOI:10.1109/TNNLS.2014.2359798delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Nystrom method is an efficient technique for the eigenvalue decomposition of large kernel matrices. However, to ensure an accurate approximation, a sufficient number of columns have to be sampled. On very large data sets, the singular value decomposition (SVD) step on the resultant data submatrix can quickly dominate the computations and become prohibitive. In this paper, we propose an accurate and scalable Nystrom scheme that first samples a large column subset from the input matrix, but then only performs an approximate SVD on the inner submatrix using the recent randomized low-rank matrix approximation algorithms. Theoretical analysis shows that the proposed algorithm is as accurate as the standard Nystrom method that directly performs a large SVD on the inner submatrix. On the other hand, its time complexity is only as low as performing a small SVD. Encouraging results are obtained on a number of large-scale data sets for low-rank approximation. Moreover, as the most computational expensive steps can be easily distributed and there is minimal data transfer among the processors, significant speedup can be further obtained with the use of multiprocessor and multi-GPU systems.
Keyword:
Distributed computing
graphics processor
large-scale learning
low-rank matrix approximation
Nystrom method
randomized SVD
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
C
Carnegie Mellon University
学者数:
1.4W
论文数: 1.4W
被引数: 2.7W
引用论文

引用论文

err分享
err收藏
err2004-01-01
err0
errOAAI
errDennis C Turk; Robert H Dworkin
err分享
err收藏
Induced Phase Transition in BiFeO3by High-Field Electron Spin Resonance
err2004-01-01
err0
PREAI
errD. VIEHLAND; J. F. LI; S. ZVYAGIN; A. P. PYATAKOV; A. BUSH; B. RUETTE; V. I. BELOTELOV; A. K. ZVEZDIN
err分享
err收藏
err分享
err收藏
学者 查看更多内容