arrow
Return

Direct conditional probability density estimation with sparse feature selection

delete2015-01-15
delete13
delete
OA
AI
M
M. Shiga *
V
Voot Tangkaratt
M
Masashi Sugiyama
DOI:10.1007/s10994-014-5472-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Regression is a fundamental problem in statistical data analysis, which aims at estimating the conditional mean of output given input. However, regression is not informative enough if the conditional probability density is multi-modal, asymmetric, and heteroscedastic. To overcome this limitation, various estimators of conditional densities themselves have been developed, and a kernel-based approach called least-squares conditional density estimation (LS-CDE) was demonstrated to be promising. However, LS-CDE still suffers from large estimation error if input contains many irrelevant features. In this paper, we therefore propose an extension of LS-CDE called sparse additive CDE (SA-CDE), which allows automatic feature selection in CDE. SA-CDE applies kernel LS-CDE to each input feature in an additive manner and penalizes the whole solution by a group-sparse regularizer. We also give a subgradient-based optimization method for SA-CDE training that scales well to high-dimensional large data sets. Through experiments with benchmark and humanoid robot transition datasets, we demonstrate the usefulness of SA-CDE in noisy CDE problems.
Keywords:
Conditional density estimation
Feature selection
Sparse structured norm

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.8K
Citations:
3.8W

Organization

I
Institute of Science Tokyo
Scholars:
1.2K
Papers: 387
Citations: 1.4W
G
gifu university
Scholars:
249
Papers: 104
Citations: 1.8K
Cited Papers

Cited Papers

Vehicular trajectory estimation utilizing slip angle based on GNSS Doppler/IMU
err2021-02-16
err0
errOAAI
errKanamu Takikawa; Yoshiki Atsumi; Aoki Takanose; Junichi Meguro
errShare
errSave
PECVD-grown carbon nanotubes on silicon substrates with a nickel-seeded tip-growth structure
err2006-07-01
err0
PREAI
errY. Abdi; J. Koohsorkhi; J. Derakhshandeh; S. Mohajerzadeh; H. Hoseinzadegan; M.D. Robertson; J.C. Bennett; X. Wu; H. Radamson
errShare
errSave
Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle Applications
err2017-07-25
err0
errOAAI
errMohan Krishna S.; Febin Daya J.L.; Sanjeevikumar Padmanaban; Lucian Mihet-Popa
errShare
errSave
The Right Hemisphere and Psychopathology
err2000-06-01
err0
PREAI
errJeanette Wasserstein; Gerry A. Stefanatos
errShare
errSave
researcher View more