Variational Bayesian multinomial logistic Gaussian process classification

Wanhyun Cho

doi:10.1007/s11042-017-5210-z

Variational Bayesian multinomial logistic Gaussian process classification

2017-09-26

1

PRE

AI

DOI：10.1007/s11042-017-5210-z

原文链接

原文求助

摘要

En 中文

The multinomial logistic Gaussian process is a flexible non-parametric model for multi-class classification tasks. These tasks are often involved in solving a pattern recognition problem in real life. In such contexts, the multinomial logistic function (or softmax function) is usually assumed to be the likelihood function. But, exact inferences for this model have proved challenging problem because it requires high-dimensional integration. In this paper, we propose approximate variational Bayesian inference for the multinomial logistic Gaussian process model. First, we compute the second-order approximation for the logarithm of the logistic likelihood function using Taylor series expansion, and derive the posterior distributions of all hidden variables and model parameters using the variational Bayesian inference method. Second, we derive the predictive distribution of the latent classification variable corresponding to the relevant test data point using the characteristics of the Cauchy product for a standard Gaussian process using a learning model parameter. We conducted experiments to verify the effectiveness of the proposed model using a number of synthetic and real datasets. The results show that the proposed model has superior classification capability to existing methods.

Keyword:

Gaussian process model

Multinomial logistic likelihood function

Variational Bayesian inference

Prior distribution

Approximate posterior distribution

Predictive distribution

Synthetic and real datasets

Variational Bayesian multinomial logistic Gaussian process classification

摘要

AI总结

期刊

机构

引用论文