Evolutionary kernel density regression

Oliver Krämer

doi:10.1016/j.eswa.2012.02.080

Return

Evolutionary kernel density regression

2012-08-01

PRE

Oliver Krämer *

Fabian Gieseke

DOI：10.1016/j.eswa.2012.02.080

Original

Original request for help

Save

Abstract

En 中文

The Nadaraya-Watson estimator, also known as kernel regression, is a density-based regression technique. It weights output values with the relative densities in input space. The density is measured with kernel functions that depend on bandwidth parameters. In this work we present an evolutionary bandwidth optimizer for kernel regression. The approach is based on a robust loss function, leave-one-out cross-validation, and the CMSA-ES as optimization engine. A variant with local parameterized Nadaraya-Watson models enhances the approach, and allows the adaptation of the model to local data space characteristics. The unsupervised counterpart of kernel regression is an approach to learn principal manifolds. The learning problem of unsupervised kernel regression (UKR) is based on optimizing the latent variables, which is a multimodal problem with many local optima. We propose an evolutionary framework for optimization of UKR based on scaling of initial local linear embedding solutions, and minimization of the cross-validation error. Both methods are analyzed experimentally. (C) 2012 Elsevier Ltd. All rights reserved.

Keywords:

Kernel regression

Bandwidth optimization

Manifold learning

Unsupervised kernel regression

Evolution strategies

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.