A Model of Multiple Hypothesis Testing

doi:10.1093/restud/rdag026

A Model of Multiple Hypothesis Testing

2026-05-01

0

PRE

AI

DOI：10.1093/restud/rdag026

Original

Original request for help

Save

Abstract

En 中文

Multiple hypothesis testing (MHT) practices vary widely, without consensus on which are appropriate when. This article provides an economic foundation for these practices designed to capture leading examples, such as regulatory approval on the basis of clinical trials. MHT adjustments are appropriate in our framework to the extent that research costs are invariant to the number of hypotheses. Control of average size, as for example via a Bonferroni correction, emerges in the limit case where all costs are fixed; in the opposite limit, where costs vary in proportion to the hypothesis count, no correction is needed. We illustrate implications by calculating explicit critical values using data on actual costs in the drug approval process and in program evaluation research; these suggest that some MHT adjustment is warranted in these applications, but not as much as implied by standard practice.

Keywords:

Bonferroni

Family-wise error rate

Multiple subgroups

Multiple treatments

Research costs

A Model of Multiple Hypothesis Testing

Abstract

Journal

Organization