arrow
返回

Efficient Classification by Removing Bayesian Confusing Samples

delete2024-03-01
delete1
PRE
AI
F
Fuyuan Cao
Q
Qingqiang Chen *
Y
Ying Xing
J
Jiye Liang
DOI:10.1109/TKDE.2023.3303425delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Improving the generalization performance of classifiers from data pre-processing perspective has recently received considerable attention in the machine learning community. Although many methods have been proposed in the past decades, most of them lack theoretical foundations and cannot guarantee better generalization performance of classifiers on processed datasets. To overcome this flaw, in this paper, we propose a method, which is supported by Bayesian decision theory and percolation theory, to improve generalization performance by removing Bayesian confusing samples (abbr. BCS). Specifically, for a training set, we define the samples that misclassified by the Bayesian optimal classifier as BCS and prove that a classifier trained on the training set after removing BCS can obtain better generalization performance. To find out BCS, we indicate that BCS can be identified according to the size of global homogeneous cluster, a set of samples with the same labels, based on percolation theory. Based on these analysis, we propose a method to construct global homogeneous clusters and remove BCS from the training set. Extensive experiments show that the proposed method is effective for a number of classical and state-of-the-art classifiers.
Keyword:
Bayes methods
Training
Task analysis
Data models
Boosting
Support vector machines
Lattices
Generalization performance
classification
data pre-processing
percolation theory

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

S
Shanxi University
学者数:
1.3W
论文数: 8.4K
被引数: 1.2W
引用论文

引用论文

Analysis of Aneuploidy in Spermatozoa From Testicular Biopsies From Men With Nonobstructive Azoospermia
err2013-01-02
err0
errOAAI
errRenée H. Martin; Calvin Greene; Alfred W. Rademaker; Evelyn Ko; Judy Chernos
err分享
err收藏
Leaching of Rare Earth Elements from Central Appalachian Coal Seam Underclays
err2020-06-26
err0
errOAAI
errScott N. Montross; Jonathan Yang; James Britton; Mark McKoy; Circe Verba
err分享
err收藏
Random Space Division Sampling for Label-Noisy Classification or Imbalanced Classification
err2022-10-01
err29
PREAI
errXia, Shuyin; Zheng, Yong; Wang, Guoyin; He, Ping; Li, Heng; Chen, Zizhong
err分享
err收藏
Improved Random Forest for Classification
err2018-08-01
err224
PREAI
errPaul, Angshuman; Mukherjee, Dipti Prasad; Das, Prasun; Gangopadhyay, Abhinandan; Chintha, Appa Rao; Kundu, Saurabh
err分享
err收藏
Full-Scale Simulation-Based Hull Form Design for Large Medium-Speed Catamarans with High Fuel Efficiency
err2015-09-02
err0
PREAI
errMax Haase; Gary Davidson; Stuart Friezer; Jonathan Binns; Giles Thomas; Neil Bose
err分享
err收藏
学者 查看更多内容