.png){kind=icon}
返回
Progressive Ensemble Learning for in-Sample Data Cleaning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3468035.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present an ensemble learning-based data cleaning approach (touted as ELDC) capable of identifying and pruning anomaly data. ELDC is characterized in that an ensemble of base models can be trained directly with the noisy in-sample data and can dynamically provide clean data during the iterative training. Each base model uses a random subset of the target dataset that may initially contain up to 40% of label errors. Following each training iteration, anomaly data are discriminated against clean ones by a majority voting scheme, and three different types of anomaly (mislabeled, confusing, and outliers) can be identified using a statistical pattern jointly determined by the prediction output of the base models. By iterating such a cycle of train-vote-remove, noisy in-sample data are progressively removed until a prespecified condition is reached. Comprehensive experiments, including out-sample data tests, are conducted to verify the effectiveness of ELDC in simultaneously suppressing bias and variance of the prediction output. The ELDC framework is highly flexible as it is not bound to a specific model and allows different transfer-learning configurations. Neural networks of AlexNet, ResNet50, and GoogleNet are used as based models and trained with various benchmark datasets, the results show that ELDC outperforms state-of-the-art cleaning methods.
Keyword:
Training
Data models
Cleaning
Noise measurement
Image classification
Complexity theory
Training data
Ensemble learning
Data integrity
Transfer learning
Convolutional neural networks
Noisy data
ensemble learning
data cleanliness
image classification
true labels
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
分享收藏Coal resources under carbon peak: Segmentation of massive laser point clouds for coal mining in underground dusty environments using integrated graph deep learning model碳峰值下的煤炭资源: 基于集成图深度学习模型的地下尘土环境下煤炭开采的海量激光点云分割.png)
ENERGY
ENERGYIF9.4
PREAI
分享收藏分享收藏Evolutionary multi-objective optimization based ensemble autoencoders for image outlier detectionNEUROCOMPUTING
OAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏分享收藏分享收藏Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks避免过拟合: 卷积神经网络正则化方法综述OAAI
OAAI分享收藏
查看更多内容