arrow
Return

Score-Based Hypothesis Testing for Unnormalized Models

delete2022-01-01
delete4
delete
OA
AI
S
Suya Wu *
E
Enmao Diao
K
Khalil Elkhalil
J
Jie Ding
V
Vahid Tarokh
DOI:10.1109/ACCESS.2022.3187991delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unnormalized statistical models play an important role in machine learning, statistics, and signal processing. In this paper, we derive a new hypothesis testing procedure for unnormalized models. Our approach is motivated by the success of score matching techniques that avoid the intensive computational costs of normalization constants in many high-dimensional settings. Our proposed test statistic is the difference between Hyvarinen scores corresponding to the null and alternative hypotheses. Under some reasonable conditions, we prove that the asymptotic distribution of this statistic is Chi-squared. We outline a bootstrap approach to learn the test critical values, particularly when the distribution under the null hypothesis cannot be expressed in a closed form, and provide consistency guarantees. Finally, we conduct extensive numerical experiments and demonstrate that our proposed approach outperforms goodness-of-fit benchmarks in various settings.
Keywords:
Testing
Light rail systems
Computational modeling
Density functional theory
Probability density function
Minimization
Mathematical models
Hypothesis testing
goodness-of-fit
score matching
unnormalized statistical models

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

D
Duke University
Scholars:
6.3W
Papers: 5.7W
Citations: 6.5W