1
Return

Comparing predictive ability in the presence of instability over a very short time

delete2025-10-01
delete0
PRE
AI
I
Iacone, Fabrizio *
R
Rossini, Luca
V
Viselli, Andrea
DOI:10.1093/ectj/utaf018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We consider forecast comparison in the presence of instability when this affects only a short period of time. We demonstrate that global tests do not perform well in this case because they were not designed to capture very short-lived instabilities, and their power vanishes altogether when the magnitude of the shock is very large. We then discuss non-parametric approaches that are more suitable to detect such situations. We illustrate these results in a Monte Carlo exercise and in a comparison of the nowcast of the quarterly US nominal GDP from the Survey of Professional Forecasters against a naive benchmark of no growth, over a period that includes the GDP instability brought by the COVID-19 crisis. We recommend that forecasters do not pool the sample, but exclude the short periods of high local instability from the evaluation exercise.
Keywords:
Forecast evaluation
local diagnostics
structural instability test
change point
SPF

Journal

Econometrics Journal cover
Econometrics Journal
IF:
7
Papers:
565
Citations:
2.3K

Organization

U
University of Milan
Scholars:
5.0W
Papers: 3.9W
Citations: 5.0W
Cited Papers

Cited Papers

Citing Papers

Citing Papers