arrow
Return

Localizing Strictly Proper Scoring Rules

delete2025-12-01
delete0
delete
OA
AI
R
Ramon F. A. de Punder
C
Cees Diks *
R
Roger J. A. Laeven
V
van Dijk, Dick J. C.
DOI:10.1080/01621459.2025.2576189delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
When comparing predictive distributions, forecasters are typically not equally interested in all regions of the outcome space. To address the demand for focused forecast evaluation, we propose a procedure to transform strictly proper scoring rules into their localized counterparts while preserving the score divergence and strict propriety. This is accomplished by applying the original scoring rule to a censored distribution. Our procedure nests the censored likelihood score as a special case. Among a multitude of others, it also implies a class of censored kernel scores that offers a (possibly multivariate) alternative to the threshold weighted Continuously Ranked Probability Score (twCRPS), extending its local propriety to more general weight functions than single tail indicators. Within this localized framework, we obtain a generalization of the Neyman Pearson lemma, establishing the censored likelihood ratio test as uniformly most powerful. For other tests of localized predictive performance, results of Monte Carlo simulations and empirical applications to risk management, inflation and climate data consistently emphasize the excellent power properties of censoring versus other localization methods. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
Keywords:
Censoring
CRPS
Density forecast evaluation
Likelihood ratio
Tests of equal predictive ability

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

U
university of amsterdam
Scholars:
6.0W
Papers: 5.1W
Citations: 94
T
Tinbergen Institute
Scholars:
171
Papers: 183
Citations: 629