arrow
Return

Randomized sketches for kernel CCA

delete2020-07-01
delete5
PRE
AI
H
Heng Lian *
F
Fode Zhang
W
Wenqi Lu
DOI:10.1016/j.neunet.2020.04.006delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Kernel canonical correlation analysis (KCCA) is a popular tool as a nonlinear extension of canonical correlation analysis. Consistency and optimal convergence rate have been established in the literature. However, the time complexity of KCCA scales as O(n(3)) and is thus prohibitive when n is large. We propose an m-dimensional randomized sketches approach for KCCA with m << n, based on the recent work on randomized sketches for kernel ridge regression (KRR). Technically we establish our theoretical results relying on an interesting connection between KCCA and KRR by utilizing a novel duality tracking device that alternates between the infinite-dimensional operator-theory-based view of KCCA and the finite-dimensional kernel-matrix-based view. (C) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Canonical correlation analysis
Covariance/cross-covariance operator
Kernel method
Random projection

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W