arrow
Return

Bayesian Dependent Mixture Models: A Predictive Comparison and Survey

delete2025-01-01
delete0
PRE
AI
S
Sara Wade *
V
Vanda Inácio
DOI:10.1214/24-STS966delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
For exchangeable data, mixture models are an extremely useful tool for density estimation due to their attractive balance between smoothness and flexibility. When additional covariate information is present, mixture models can be extended for flexible regression by modeling the mixture parameters, namely, the weights and atoms, as functions of the covariates. These types of models are interpretable and highly flexible, allowing not only the mean but the whole density of the response to change with the covariates. This article reviews Bayesian covariate-dependent mixture models, focusing on nonparametric constructions which we broadly organize into into three categories: (1) joint models of the responses and covariates, (2) conditional models with single-weights and covariate-dependent atoms, and (3) conditional models with covariate-dependent weights. The diversity and variety of the available models in the literature raises the question of how to choose among them for the application at hand. We attempt to shed light on this question through a careful analysis of the predictive equations for the conditional mean and density function as well as predictive comparisons in a variety of simulated data examples.
Keywords:
Density regression
dependent Dirichlet process
mixture of experts
nonparametric regression
stick-breaking representation

Journal

Statistical Science cover
Statistical Science
IF:
3.4
Papers:
1.0K
Citations:
8.7K

Organization

U
University of Edinburgh
Scholars:
5.1W
Papers: 4.6W
Citations: 71