返回
Information potential for some probability density functions
DOI:10.1016/j.amc.2020.125578.png)
摘要
En 中文
This paper is related to the information theoretic learning methodology, whose goal is to quantify global scalar descriptors (e.g., entropy) of a given probability density function (PDF). In this context, the core concept is the information potential (IP) S-[s](x) := integral(R) p(s) (t, x)dt, s > 0 of a PDF p(t, x) depending on a parameter x; it is naturally related to the Renyi and Tsallis entropies. We present several such PDF, viewed also as kernels of integral operators, for which a precise relation exists between S-[2](x) and the variance Var[p(t, x)]. For these PDF we determine explicitly the IP and the Shannon entropy. As an application to Information Theoretic Learning we determine two essential indices used in this theory: the expected value E[logp(t, x)] and the variance Var[logp(t, x)]. The latter is an index of the intrinsic shape of p(t, x) having more statistical power than kurtosis. For a sequence of B-spline functions, considered as kernels of Steklov operators and also as PDF, we investigate the sequence of IP and its asymptotic behaviour. Another special sequence of PDF consists of kernels of Kantorovich modifications of the classical Bernstein operators. Convexity properties and bounds of the associated IP, useful in Information Theoretic Learning, are discussed. Several examples and numerical computations illustrate the general results. (C) 2020 Elsevier Inc. All rights reserved.
Keyword:
Probability density function
Information potential
Entropy
Positive linear operators
B-spline functions
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.4
论文数:
2.3W
被引数:
3.3W

