arrow
返回

Gaussian Processes for POMDP-Based Dialogue Manager Optimization

delete2014-01-01
delete65
delete
OA
AI
M
Milica Gašić *
S
Steve Young
DOI:10.1109/TASL.2013.2282190delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
A partially observable Markov decision process (POMDP) has been proposed as a dialog model that enables automatic optimization of the dialog policy and provides robustness to speech understanding errors. Various approximations allow such a model to be used for building real-world dialog systems. However, they require a large number of dialogs to train the dialog policy and hence they typically rely on the availability of a user simulator. They also require significant designer effort to hand-craft the policy representation. We investigate the use of Gaussian processes (GPs) in policy modeling to overcome these problems. We show that GP policy optimization can be implemented for a real world POMDP dialog manager, and in particular: 1) we examine different formulations of a GP policy to minimize variability in the learning process; 2) we find that the use of GP increases the learning rate by an order of magnitude thereby allowing learning by direct interaction with human users; and 3) we demonstrate that designer effort can be substantially reduced by basing the policy directly on the full belief space thereby avoiding ad hoc feature space modeling. Overall, the GP approach represents an important step forward towards fully automatic dialog policy optimization in real world systems.
Keyword:
Gaussian process
POMDP
statistical dialog systems
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
引用论文

引用论文

Natural Actor-Critic
err2008-03-01
err643
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management
err2010-04-01
err334
errOAAI
errYoung, Steve; Gasic, Milica; Keizer, Simon; Mairesse, Francois; Schatzmann, Jost; Thomson, Blaise; Yu, Kai
err分享
err收藏
Hybrid Reinforcement/Supervised Learning of Dialogue Policies from Fixed Data Sets
err2008-12-01
err79
errOAAI
errHenderson, James; Lemon, Oliver; Georgila, Kallirroi
err分享
err收藏
err分享
err收藏
err1982-01-01
err0
errOAAI
errYuji Baba
err分享
err收藏
An endogenous substrate for cGMP-dependent protein kinase in mammalian cerebellum
err1978-05-01
err0
PREAI
errDORIS J. SCHLICHTER; JOHN E. CASNELLIE; PAUL GREENGARD
err分享
err收藏
学者 查看更多内容