arrow
Return

Scoring rules and survey density forecasts

delete2011-04-01
delete28
PRE
AI
G
Gianna Boero
J
Jeremy Smith
K
Kenneth F. Wallis *
DOI:10.1016/j.ijforecast.2010.04.003delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article provides a practical evaluation of some leading density forecast scoring rules in the context of forecast surveys. We analyse the density forecasts of UK inflation obtained from the Bank of England's Survey of External Forecasters, considering both the survey average forecasts published in the Bank's quarterly Inflation Report, and the individual survey responses recently made available to researchers by the Bank. The density forecasts are collected in histogram format, and the ranked probability score (RPS) is shown to have clear advantages over other scoring rules. Missing observations are a feature of forecast surveys, and we introduce an adjustment to the RPS, based on the Yates decomposition, to improve its comparative measurement of forecaster performance in the face of differential non-response. The new measure, denoted RPS*, is recommended to analysts of forecast surveys. (C) 2010 International Institute of Forecasters. Published by Elsevier B.V. All rights reserved.
Keywords:
Density forecast evaluation
Brier (quadratic probability) score
Epstein (ranked probability) score
Logarithmic score
Bank of England Survey of External Forecasters
Missing data
Forecast comparison
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Forecasting cover
International Journal of Forecasting
IF:
7.1
Papers:
3.1K
Citations:
9.9K

Organization

U
University of Warwick
Scholars:
2.2W
Papers: 2.2W
Citations: 85