arrow
Return

Model-based kernel sum rule: kernel Bayesian inference with probabilistic models

delete2020-01-02
delete3
delete
OA
AI
Y
Yu Nishiyama *
M
Motonobu Kanagawa
A
Arthur Gretton
K
Kenji Fukumizu
DOI:10.1007/s10994-019-05852-9delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Kernel Bayesian inference is a principled approach to nonparametric inference in probabilistic graphical models, where probabilistic relationships between variables are learned from data in a nonparametric manner. Various algorithms of kernel Bayesian inference have been developed by combining kernelized basic probabilistic operations such as the kernel sum rule and kernel Bayes' rule. However, the current framework is fully nonparametric, and it does not allow a user to flexibly combine nonparametric and model-based inferences. This is inefficient when there are good probabilistic models (or simulation models) available for some parts of a graphical model; this is in particular true in scientific fields where models are the central topic of study. Our contribution in this paper is to introduce a novel approach, termed the model-based kernel sum rule (Mb-KSR), to combine a probabilistic model and kernel Bayesian inference. By combining the Mb-KSR with the existing kernelized probabilistic rules, one can develop various algorithms for hybrid (i.e., nonparametric and model-based) inferences. As an illustrative example, we consider Bayesian filtering in a state space model, where typically there exists an accurate probabilistic model for the state transition process. We propose a novel filtering method that combines model-based inference for the state transition process and data-driven, nonparametric inference for the observation generating process. We empirically validate our approach with synthetic and real-data experiments, the latter being the problem of vision-based mobile robot localization in robotics, which illustrates the effectiveness of the proposed hybrid approach.
Keywords:
Kernel methods
Probabilistic models
Kernel mean embedding
Kernel Bayesian inference
Reproducing kernel Hilbert spaces
Filtering
State space models
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

E
eberhard karls university of tubingen
Scholars:
3.3W
Papers: 2.5W
Citations: 38
U
University College London
Scholars:
7.9W
Papers: 6.2W
Citations: 15.7W
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
U
university of electro-communications - japan
Scholars:
2.6K
Papers: 2.5K
Citations: 2
researcher View more organizations