Multibenchmark reality checks

Ignacio Arbués

doi:10.1016/j.econmod.2024.106848

Return

Multibenchmark reality checks

2024-11-01

Ignacio Arbués

Mariano Matilla‐García *

DOI：10.1016/j.econmod.2024.106848

Original

Save

View PDF

Abstract

En 中文

Empirical economic modelers often have to choose between two classes of models, with each class containing multiple models. In many cases, this decision is based on the predictive ability of the considered models. This entails that multiple testing and/or p-hacking pose known risks. This study presents a new statistical approach for comparing all model in a single test, serving as a multi-benchmark reality check test. The behavior of the test is studied asymptotically and in small finite samples. We show how the new approach works by analyzing whether one family of linear bivariate models outperforms a univariate family in predicting commodity prices. This paper raises new questions for future research. From an empirical viewpoint, we present several open questions in economic modeling that can be tested with multi-benchmark tests. Meanwhile, from a theoretical viewpoint, further studies can investigate whether a more general method for approximating or simulating the test distribution can be developed.

Keywords:

Granger causality

Out-of-sample forecast

Model selection

Bootstrap

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.