arrow
Return

Maximum entropy sampling and optimal Bayesian experimental design

delete2002-01-06
delete166
delete
OA
AI
P
Paola Sebastiani *
H
Henry P. Wynn
DOI:10.1111/1467-9868.00225delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
When Shannon entropy is used as a criterion in the optimal design of experiments, advantage can be taken of the classical identity representing the joint entropy of parameters and observations as the sum of the marginal entropy of the observations and the preposterior conditional entropy of the parameters. Following previous work in which this idea was used in spatial sampling, the method is applied to standard parameterized Bayesian optimal experimental design. Under suitable conditions, which include non-linear as well as linear regression models, it is shown in a few steps that maximizing the marginal entropy of the sample is equivalent to minimizing the preposterior entropy, the usual Bayesian criterion, thus avoiding the use of conditional distributions. It is shown using this marginal formulation that under normality assumptions every standard model which has a two-point prior distribution on the parameters gives an optimal design supported on a single point. Other results include a new asymptotic formula which applies as the error variance is large and bounds on support size.
Keywords:
Bayesian optimal design
finite mixture
Shannon entropy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the Royal Statistical Society Series B-Statistical Methodology
IF:
3.6
Papers:
1.5K
Citations:
3.2W

Organization

No organization information available