arrow
返回

Generalized Data Thinning Using Sufficient Statistics

delete2024-06-13
delete0
delete
OA
AI
A
Ameer Dharamshi *
A
Anna Neufeld
K
Keshav Motwani
L
Lucy L. Gao
D
Daniela Witten
J
Jacob Bien
DOI:10.1080/01621459.2024.2353948delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Our goal is to develop a general strategy to decompose a random variable X into multiple independent random variables, without sacrificing any information about unknown parameters. A recent paper showed that for some well-known natural exponential families, X can be thinned into independent random variables X-(1),& mldr;,X-(K) , such that X=& sum;X-K(k=1)(k) . These independent random variables can then be used for various model validation and inference tasks, including in contexts where traditional sample splitting fails. In this article, we generalize their procedure by relaxing this summation requirement and simply asking that some known function of the independent random variables exactly reconstruct X. This generalization of the procedure serves two purposes. First, it greatly expands the families of distributions for which thinning can be performed. Second, it unifies sample splitting and data thinning, which on the surface seem to be very different, as applications of the same principle. This shared principle is sufficiency. We use this insight to perform generalized thinning operations for a diverse set of families. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
Keyword:
Cross-validation
Exponential families
Model validation
Sample splitting
Selective inference

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

U
University of Washington
学者数:
8.0W
论文数: 7.0W
被引数: 12.5W
F
Fred Hutchinson Cancer Center
学者数:
1.2W
论文数: 9.3K
被引数: 18
U
University of British Columbia
学者数:
7.0W
论文数: 6.1W
被引数: 8.6W
学者 查看更多机构
引用论文

引用论文

Loss of mammalian Sprouty2 leads to enteric neuronal hyperplasia and esophageal achalasia
err2005-06-05
err0
PREAI
errTakaharu Taketomi; Daigo Yoshiga; Koji Taniguchi; Takashi Kobayashi; Atsushi Nonami; Reiko Kato; Mika Sasaki; Atsuo Sasaki; Hitoshi Ishibashi; Maiko Moriyama; Kei-ichiro Nakamura; Junji Nishimura; Akihiko Yoshimura
err分享
err收藏
err分享
err收藏
Polymerization of long chain [meth]acrylates by Cu(0)-mediated and catalytic chain transfer polymerisation (CCTP): high fidelity end group incorporation and modification
err2013-01-01
err0
PREAI
errAthina Anastasaki; Christopher Waldron; Vasiliki Nikolaou; Paul Wilson; Ronan McHale; Timothy Smith; David M. Haddleton
err分享
err收藏
EXACT POST-SELECTION INFERENCE, WITH APPLICATION TO THE LASSO精确的选择后推理,并应用于套索
err2016-06-01
err552
errOAAI
errLee, Jason D.; Sun, Dennis L.; Sun, Yuekai; Taylor, Jonathan E.
err分享
err收藏
UNIFORM ASYMPTOTIC INFERENCE AND THE BOOTSTRAP AFTER MODEL SELECTION一致渐近推断和模型选择后的自举
err2018-06-01
err57
errOAAI
errTibshirani, Ryan J.; Rinaldo, Alessandro; Tibshirani, Rob; Wasserman, Larry
err分享
err收藏
学者 查看更多内容