arrow
返回

Quantized Minimum Error Entropy Criterion

delete2019-05-01
delete38
delete
OA
AI
B
Badong Chen *
L
Lei Xing
N
Nanning Zheng
J
José C. Prı́ncipe
DOI:10.1109/TNNLS.2018.2868812delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Comparing with traditional learning criteria, such as mean square error, the minimum error entropy (MEE) criterion is superior in nonlinear and non-Gaussian signal processing and machine learning. The argument of the logarithm in Renyi's entropy estimator, called information potential (IP), is a popular MEE cost in information theoretic learning. The computational complexity of IP is, however, quadratic in terms of sample number due to double summation. This creates the computational bottlenecks, especially for large-scale data sets. To address this problem, in this paper, we propose an efficient quantization approach to reduce the computational burden of IP, which decreases the complexity from O(N-2) to O(MN) with M << N. The new learning criterion is called the quantized MEE (QMEE). Some basic properties of QMEE are presented. Illustrative examples with linear-in-parameter models are provided to verify the excellent performance of QMEE.
Keyword:
Computational complexity
information theoretic learning (ITL)
minimum error entropy (MEE)
quantization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.5K
被引数:
7.2W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
引用论文

引用论文

err分享
err收藏
Quantized Kernel Recursive Least Squares Algorithm
err2013-09-01
err177
PREAI
errChen, Badong; Zhao, Songlin; Zhu, Pingping; Principe, Jose C.
err分享
err收藏
PECVD-grown carbon nanotubes on silicon substrates with a nickel-seeded tip-growth structure具有镍种子尖端生长结构的硅衬底上的PECVD生长的碳纳米管
err2006-07-01
err0
PREAI
errY. Abdi; J. Koohsorkhi; J. Derakhshandeh; S. Mohajerzadeh; H. Hoseinzadegan; M.D. Robertson; J.C. Bennett; X. Wu; H. Radamson
err分享
err收藏
Roller compacted concrete with high values of strength, frost resistance, and impermeability
err1992-07-01
err0
PREAI
errA. D. Osipov; S. V. Sharkunov; S. N. Semenenok; A. S. Magiton
err分享
err收藏
学者 查看更多内容