arrow
Return

Gradient-Based Kernel Dimension Reduction for Regression

delete2014-03-19
delete57
PRE
AI
K
Kenji Fukumizu *
C
Chenlei Leng
DOI:10.1080/01621459.2013.838167delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article proposes a novel approach to linear dimension reduction for regression using nonparametric estimation with positive-definite kernels or reproducing kernel Hilbert spaces (RKHSs). The purpose of the dimension reduction is to find such directions in the explanatory variables that explain the response sufficiently: this is called sufficient dimension reduction. The proposed method is based on an estimator for the gradient of the regression function considered for the feature vectors mapped into RKHSs. It is proved that the method is able to estimate the directions that achieve sufficient dimension reduction. In comparison with other existing methods, the proposed one has wide applicability without strong assumptions on the distributions or the type of variables, and needs only eigendecomposition for estimating the projection matrix. The theoretical analysis shows that the estimator is consistent with certain rate under some conditions. The experimental results demonstrate that the proposed method successfully finds effective directions with efficient computation even for high-dimensional explanatory variables.
Keywords:
Conditional independence
Kernel method
Reproducing kernel Hilbert space
Sufficient dimension reduction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

I
institute of statistical mathematics (ism) - japan
Scholars:
347
Papers: 320
Citations: 0
R
research organization of information & systems (rois)
Scholars:
2.8K
Papers: 3.2K
Citations: 2