arrow
返回

An introduction to variational methods for graphical models

delete1999-01-01
delete2.3K
delete
OA
AI
M
Michael I. Jordan
Z
Zoubin Ghahramani
J
Jaakkola, TS
L
Lawrence K. Saul
DOI:10.1023/A:1007665907178delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper presents a tutorial introduction to the use of variational methods for inference and learning in graphical models (Bayesian networks and Markov random fields). We present a number of examples of graphical models, including the QMR-DT database, the sigmoid belief network, the Boltzmann machine, and several variants of hidden Markov models, in which it is infeasible to run exact inference algorithms. We then introduce variational methods, which exploit laws of large numbers to transform the original graphical model into a simplified graphical model in which inference is efficient. Inference in the simpified model provides bounds on probabilities of interest in the original model. We describe a general framework for generating variational transformations based on convex duality. Finally we return to the examples and demonstrate how variational algorithms can be formulated in each case.
Keyword:
graphical models
Bayesian networks
belief networks
probabilistic inference
approximate inference
variational methods
mean field methods
hidden Markov models
Boltzmann machines
neural networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

暂无机构信息
引用论文

引用论文

暂无论文信息