Return
Bayesian Model Comparison and Significance: Widespread Errors and How to Correct Them
DOI:10.3847/1538-4365/ae0e71.png)
Abstract
En 中文
Bayes factors have become a popular tool in exoplanet spectroscopy for testing atmosphere models against one another. We show that the commonly used method for converting these values into significance “sigmas” is invalid. The formula is neither justified nor recommended by its original paper, and overestimates the confidence of results. We use simple examples to demonstrate the invalidity and prior sensitivity of this approach. We review the standard Bayesian interpretation of the Bayes factor as an odds ratio and recommend its use in conjunction with the Akaike information criterion or Bayesian predictive information criterion simplified in future analyses (Python implementations are included). As a concrete example, we refit the WASP-39 b NIRSpec transmission spectrum to test for the presence of SO2. The prevalent, incorrect significance calculation gives 3.67σ, whereas the standard Bayesian interpretation yields a null model probability . Surveying the exoplanet atmosphere literature, we find widespread use of the erroneous formula. In order to avoid overstating observational results and estimating observation times too low, the community should return to the standard Bayesian interpretation.
Keywords:
Bayes factor
model comparison
significance
exoplanet atmosphere
Bayesian inference
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
T
IF:
0
Papers:
139
Citations:
0

