arrow
Return

On the Parzen Kernel-Based Probability Density Function Learning Procedures Over Time-Varying Streaming Data With Applications to Pattern Classification

delete2020-04-01
delete27
PRE
AI
P
Piotr Duda *
L
Leszek Rutkowski
M
Maciej Jaworski
D
Danuta Rutkowska
DOI:10.1109/TCYB.2018.2877611delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a recursive variant of the Parzen kernel density estimator (KDE) to track changes of dynamic density over data streams in a nonstationary environment. In stationary environments, well-established traditional KDE techniques have nice asymptotic properties. Their existing extensions to deal with stream data are mostly based on various heuristic concepts (losing convergence properties). In this paper, we study recursive KDEs, called recursive concept drift tracking KDEs, and prove their weak (in probability) and strong (with probability one) convergence, resulting in perfect tracking properties as the sample size approaches infinity. In three theorems and subsequent examples, we show how to choose the bandwidth and learning rate of a recursive KDE in order to ensure weak and strong convergence. The simulation results illustrate the effectiveness of our algorithm both for density estimation and classification over time-varying stream data.
Keywords:
Kernel
Convergence
Neural networks
Bandwidth
Probability density function
Estimation
Probabilistic logic
Concept drift
convergence in probability and with probability one
online density estimation
pattern classification in nonstationary environments
time-varying environment
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

U
University of Social Sciences
Scholars:
97
Papers: 114
Citations: 1
T
technical university czestochowa
Scholars:
1.3K
Papers: 1.5K
Citations: 1