arrow
返回

Statistical testing under distributional shifts

delete2023-04-21
delete3
delete
OA
AI
N
Nikolaj Thams *
S
Sorawit Saengkyongam
N
Niklas Pfister
J
Jonas Peters
DOI:10.1093/jrsssb/qkad018delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We introduce statistical testing under distributional shifts. We are interested in the hypothesis P*? H(0 )for a target distribution P*, but observe data from a different distribution Q*. We assume that P* is related to Q* through a known shift t and formally introduce hypothesis testing in this setting. We propose a general testing procedure that first resamples from the observed data to construct an auxiliary data set (similarly to sampling importance resampling) and then applies an existing test in the target domain. We prove that if the size of the resample is of order o(vn) and the resampling weights are well behaved, this procedure inherits the pointwise asymptotic level and power from the target test. If the map t is estimated from data, we maintain the above guarantees under mild conditions on the estimation. Our results extend to finite sample level, uniform asymptotic level, a different resampling scheme, and statistical inference different from testing. Testing under distributional shifts allows us to tackle a diverse set of problems. We argue that it may prove useful in contextual bandit problems and covariate shift, show how it reduces conditional to unconditional independence testing and provide example applications in causal inference.
Keyword:
distributional shifts
hypothesis testing
conditional independence testing
sampling importance resampling
causality

期刊

J
Journal of the Royal Statistical Society Series B-Statistical Methodology
IF:
3.6
论文数:
1.5K
被引数:
3.2W

机构

U
University of Copenhagen
学者数:
7.6W
论文数: 6.6W
被引数: 86
引用论文

引用论文

FOUNDATIONS OF STRUCTURAL CAUSAL MODELS WITH CYCLES AND LATENT VARIABLES
err2021-10-01
err79
errOAAI
errBongers, Stephan; Forre, Patrick; Peters, Jonas; Mooij, Joris M.
err分享
err收藏
Effects of fasting during Ramadan on seizure control and quality of life in patients with epilepsy斋月期间禁食对癫痫患者癫痫发作控制和生活质量的影响
err2020-11-01
err0
PREAI
errKhalid Alqadi; Omar Alghamdi; Fawzi Babtain; Hanan Ba'arma; Somaya Bajammal; Miad Albalawi; Abdulrahman Alfadhel; Mohammed Jawhari; Amal Abu-jabber; Nadia Madani; Youssef Al-Said; Salah Baz; Husam Kayyali
err分享
err收藏
Induction of Abortion with Mifepristone (RU 486) and Oral or Vaginal Misoprostol
err1995-04-13
err0
errOAAI
errHazem El-Refaey; Dhamnasekar Rajasekar; Mona Abdalla; Lynda Calder; Allan Templeton
err分享
err收藏
An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections
err2015-12-01
err0
errOAAI
errYu Cheng; Felix X. Yu; Rogerio S. Feris; Sanjiv Kumar; Alok Choudhary; Shi-Fu Chang
err分享
err收藏
A Review on Nanofluids: Synthesis, Stability, and Uses in the Manufacturing Industry
err2023-12-01
err0
PREAI
errJotiram G. Gujar; Sanjay S. Patil; Shriram S. Sonawane
err分享
err收藏
学者 查看更多内容