arrow
返回

Thompson Sampling for Stochastic Control: The Continuous Parameter Case

delete2019-10-01
delete8
PRE
AI
D
Dragan Banjević
M
Michael Jong Kim *
DOI:10.1109/TAC.2019.2895253delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, Thompson sampling has been shown to achieve good theoretical performance guarantees for stochastic control problems with parameter uncertainty when the state, control, and parameter spaces are all finite. Much less is known however about the performance of Thompson sampling when applied to continuous or more general spaces, which constitutes an important class of problems in practice. In this paper, we study Thompson sampling when applied to a broad class of average cost stochastic control problems where the state, control, and parameter spaces are all general measurable spaces. The main contributions of our paper are establishing theoretical performance guarantees for Thompson sampling as measured by: first, expected posterior sampling error; and second, average per period regret.
Keyword:
Average regret bounds
Bayesian learning
general parameter spaces
posterior convergence rate
Thompson sampling
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

U
University of British Columbia
学者数:
7.0W
论文数: 6.1W
被引数: 8.6W
U
university of toronto
学者数:
14.8W
论文数: 12.0W
被引数: 165
引用论文

引用论文

Convergence rates of posterior distributions for noniid observations
err2007-02-01
err224
errOAAI
errGhosal, Subhashis; Van Der Vaart, Aad
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容