arrow
Return

A two-stage optimized robust kernel density estimation for Bayesian classification with outliers

delete2025-01-07
delete0
delete
OA
AI
C
Chenghao Wei
B
Bo Peng
C
Chen Li *
Y
Yingying Liu
叶志伟 (Zhiwei Ye)
左志强 cover
左志强 (Zhiqiang Zuo)
DOI:10.1007/s13042-024-02499-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A Bayesian classifier based on kernel density estimation (KDE) is an effective method for continuous data classification. However, the presence of outliers and inappropriate selection of bandwidth may cause inaccurate and distorted estimations of the density function. It will lead to low classification performance. This paper presents an improved Bayesian classification approach by employing an optimized robust kernel density estimation (ORKDE). The impact of outliers can be down-weighted by a two-stage optimization in the conditional probability density calculation. In the first stage, an improved hybrid rice optimization (IHRO) algorithm is proposed for selecting the bandwidth of a Gaussian KDE using a mixed cross-validation function. It incorporates Levy flight and elite reverse learning strategy to enhance the global optimization searching capability. In the second stage, a soft-redescending Welsch function is applied as the loss function to reduce the weights of outliers using the M-estimation in the kernel space. The relative efficiency index is used to derive the tuning parameter of the influence function. A kernelized iteratively re-weighted least-squares procedure employs both the tuning parameter and the quantile rule for effectively calculating the optimal weights of samples. With the proposed ORKDE method, the Naive Bayesian classifier enhances the generalization in the classification with outliers. The effectiveness of our method is demonstrated by the experiments using synthetic and real-world datasets.
Keywords:
Robust classification
Robust kernel density estimation
M-estimation
Improved hybrid rice algorithm
Mixed Cross-validation

Journal

International Journal of Machine Learning and Cybernetics cover
International Journal of Machine Learning and Cybernetics
IF:
2.7
Papers:
3.1K
Citations:
5.6K

Organization

H
Hubei University of Technology
Scholars:
8.1K
Papers: 4.7K
Citations: 7.7K