arrow
Return

Algorithms for maximum-likelihood bandwidth selection in kernel density estimators

delete2012-10-01
delete17
PRE
AI
J
José M. Leiva-Murillo *
A
Antonio Artés-Rodrı́guez
DOI:10.1016/j.patrec.2012.06.006delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In machine learning and statistics, kernel density estimators are rarely used on multivariate data due to the difficulty of finding an appropriate kernel bandwidth to overcome overfitting. However, the recent advances on information-theoretic learning have revived the interest on these models. With this motivation, in this paper we revisit the classical statistical problem of data-driven bandwidth selection by cross-validation maximum likelihood for Gaussian kernels. We find a solution to the optimization problem under both the spherical and the general case where a full covariance matrix is considered for the kernel. The fixed-point algorithms proposed in this paper obtain the maximum likelihood bandwidth in few iterations, without performing an exhaustive bandwidth search, which is unfeasible in the multivariate case. The convergence of the methods proposed is proved. A set of classification experiments are performed to prove the usefulness of the obtained models in pattern recognition. (c) 2012 Elsevier B.V. All rights reserved.
Keywords:
Kernel density estimation
Multivariate density modeling
Pattern recognition

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
8.0K
Citations:
1.6W

Organization

U
Universidad Carlos III de Madrid
Scholars:
5.5K
Papers: 5.7K
Citations: 4.5K
Cited Papers

Cited Papers

Slow Traveling Wave Solutions to the Hodgkin-Huxley Equations
err1987-01-01
err0
PREAI
errHideo Ikeda; Masayasu Mimura; Tohru Tsujikawa
errShare
errSave
Electric load forecasting using an artificial neural network
err1991-05-01
err0
errOAAI
errD.C. Park; M.A. El-Sharkawi; R.J. Marks; L.E. Atlas; M.J. Damborg
errShare
errSave
errShare
errSave
sCMOS detector for imaging VNIR spectrometry
err2013-09-23
err0
PREAI
errAndreas Eckardt; Ralf Reulke; Horst Schwarzer; Holger Venus; Christian Neumann
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more