arrow
Return

Prediction-Powered Model Checking via Predictiveness Comparisons

delete2026-02-05
delete0
PRE
AI
Y
Yanhong Liu
Y
Yinxu Jia
G
Guanghui Wang *
Z
Zhaojun Wang
C
Changliang Zou
DOI:10.1007/s11424-026-5075-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Model checking evaluates whether a statistical model faithfully captures the underlying data-generating process. Classical tests — such as local-smoothing and empirical-process methods — break down in high dimensions. More recent approaches use predictiveness comparisons with flexible machine-learning model fitting procedures to yield algorithm-agnostic tests, yet they require large labeled samples. The authors introduce a prediction-powered, semi-supervised framework that: 1) Imputes responses for unlabeled data via a pretrained model; 2) Corrects imputation bias with a rectifier calibrated on labeled data; 3) Adaptively balances these components through a data-driven power-tuning parameter. Building on algorithm-agnostic out-of-sample predictiveness comparisons, the proposed method integrates unlabeled information to enhance power. Theoretical analyses and numerical results demonstrate that the proposed test controls Type I error and substantially improves power over fully supervised counterparts, even under imputation-model misspecification.
Keywords:
Algorithm-agnostic inference
asymptotic normality
model checking
prediction-powered inference
semi-supervised inference

Journal

Journal of Systems Science and Complexity cover
Journal of Systems Science and Complexity
IF:
2.8
Papers:
212
Citations:
2.1K

Organization

S
School of Statistics and Data Science
Scholars:
58
Papers: 29
Citations: 0
G
Guangzhou Institute of International Finance
Scholars:
3
Papers: 2
Citations: 0