arrow
返回

Restricted Minimum Error Entropy Criterion for Robust Classification

delete2022-11-01
delete7
delete
OA
AI
Y
Yuanhao Li *
B
Badong Chen
N
Natsue Yoshimura
Y
Yasuharu Koike
DOI:10.1109/TNNLS.2021.3082571delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The minimum error entropy (MEE) criterion is a powerful approach for non-Gaussian signal processing and robust machine learning. However, the instantiation of MEE on robust classification is a rather vacancy in the literature. The original MEE purely focuses on minimizing Renyi's quadratic entropy of the prediction errors, which could exhibit inferior capability in noisy classification tasks. To this end, we analyze the optimal error distribution with adverse outliers and introduce a specific codebook for restriction, which optimizes the error distribution toward the optimal case. Half-quadratic-based optimization and convergence analysis of the proposed learning criterion, called restricted MEE (RMEE), are provided. The experimental results considering logistic regression and extreme learning machine on synthetic data and UCI datasets, respectively, are presented to demonstrate the superior robustness of RMEE. Furthermore, we evaluate RMEE on a noisy electroencephalogram dataset, so as to strengthen its practical impact.
Keyword:
Entropy
Logistics
Probability density function
Training
Robustness
Optimization
Noise measurement
Half-quadratic (HQ) optimization
information-theoretic learning (ITL)
minimum error entropy (MEE) criterion
robust classification
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

I
Institute of Science Tokyo
学者数:
3.2W
论文数: 2.7W
被引数: 117
T
Tokyo Institute of Technology
学者数:
1.1W
论文数: 9.0K
被引数: 1.9W
引用论文

引用论文

Principal component analysis based on non-parametric maximum entropy
err2010-06-01
err41
PREAI
errHe, Ran; Hu, Baogang; Yuan, XiaoTong; Zheng, Wei-Shi
err分享
err收藏
Robust C-Loss Kernel Classifiers
err2018-03-01
err34
PREAI
errXu, Guibiao; Hu, Bao-Gang; Principe, Jose C.
err分享
err收藏
Weighted least squares support vector machines: robustness and sparse approximation
err2002-10-01
err1.3K
errOAAI
errSuykens, JAK; De Brabanter, J; Lukas, L; Vandewalle, J
err分享
err收藏
学者 查看更多内容