arrow
Return

Bayesian Model Comparison and Significance: Widespread Errors and How to Correct Them

delete2026-02-20
delete0
delete
OA
AI
D
Daniel Thorngren
D
David K. Sing
S
Sagnick Mukherjee
DOI:10.3847/1538-4365/ae0e71delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Bayes factors have become a popular tool in exoplanet spectroscopy for testing atmosphere models against one another. We show that the commonly used method for converting these values into significance “sigmas” is invalid. The formula is neither justified nor recommended by its original paper, and overestimates the confidence of results. We use simple examples to demonstrate the invalidity and prior sensitivity of this approach. We review the standard Bayesian interpretation of the Bayes factor as an odds ratio and recommend its use in conjunction with the Akaike information criterion or Bayesian predictive information criterion simplified in future analyses (Python implementations are included). As a concrete example, we refit the WASP-39 b NIRSpec transmission spectrum to test for the presence of SO2. The prevalent, incorrect significance calculation gives 3.67σ, whereas the standard Bayesian interpretation yields a null model probability . Surveying the exoplanet atmosphere literature, we find widespread use of the erroneous formula. In order to avoid overstating observational results and estimating observation times too low, the community should return to the standard Bayesian interpretation.
Keywords:
Bayes factor
model comparison
significance
exoplanet atmosphere
Bayesian inference
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

T
The Astrophysical Journal Supplement Series
IF:
0
Papers:
139
Citations:
0

Organization

U
university of california
Scholars:
1.9W
Papers: 8.0K
Citations: 10
J
johns hopkins university
Scholars:
1.0W
Papers: 3.9K
Citations: 1