返回
Restricted Minimum Error Entropy Criterion for Robust Classification
DOI:10.1109/TNNLS.2021.3082571.png)
摘要
En 中文
The minimum error entropy (MEE) criterion is a powerful approach for non-Gaussian signal processing and robust machine learning. However, the instantiation of MEE on robust classification is a rather vacancy in the literature. The original MEE purely focuses on minimizing Renyi's quadratic entropy of the prediction errors, which could exhibit inferior capability in noisy classification tasks. To this end, we analyze the optimal error distribution with adverse outliers and introduce a specific codebook for restriction, which optimizes the error distribution toward the optimal case. Half-quadratic-based optimization and convergence analysis of the proposed learning criterion, called restricted MEE (RMEE), are provided. The experimental results considering logistic regression and extreme learning machine on synthetic data and UCI datasets, respectively, are presented to demonstrate the superior robustness of RMEE. Furthermore, we evaluate RMEE on a noisy electroencephalogram dataset, so as to strengthen its practical impact.
Keyword:
Entropy
Logistics
Probability density function
Training
Robustness
Optimization
Noise measurement
Half-quadratic (HQ) optimization
information-theoretic learning (ITL)
minimum error entropy (MEE) criterion
robust classification
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Weighted least squares support vector machines: robustness and sparse approximation
NEUROCOMPUTING
IF6.5

