返回
Three information-theoretical methods to estimate a random variable
DOI:10.1006/jema.1996.0115.png)
摘要
En 中文
Three information-theoretical methods to estimate a continuous univariate distribution are proposed for estimation when the distribution type is uncertain, when data are scarce, or when extremes are important. The first is a new version of Jaynes' MaxEnt Method. The second, minimizing Shannon's information measure, yields a minimally informative estimate. The third analysis produces a pair of distributions that together minimize the relative entropy (=cross-entropy) satisfying the principle of least information. Thus, one distribution (p) provides minimal information among all chosen candidates about these events, while the other (q) minimizes the information among all distributions that satisfies the sample rule, which is an essential constraint. Model p is also identical to the ''maximum product of spacings'' estimate. Distribution q is determined from p by simple algebra. The principle of least information yields a unique solution (p,q) when other methods fail. The algorithm is the same for all types of distributions; the estimation process introduces a minimum of information, approaching objectivity, and the solution is invariant under monotonic variable transformations. All three methods are computationally simple but involve optimization. There are also several approximate information-theoretical methods that retain some of the advantages cited and are computationally simpler. (C) 1997 Academic Press Limited
Keyword:
distribution
estimation
information
entropy
sample
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

