arrow
返回

Personalized Dialogue Policy Learning Framework Based on Implicit User Profiles

delete2025-11-18
delete0
PRE
AI
K
Kai Xu
王振宇 封面图
王振宇 (Zhenyu Wang)
Y
Yuxuan Long
张瑞 封面图
张瑞 (Rui Zhang)
DOI:10.1109/THMS.2025.3620160delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Dialogue policy is a core module in pipeline dialogue systems as it drives conversation generation. Personalized dialogue policies aim to equip chatbots with tailored personalities, making them behave like real users, providing more accurate action responses, and improving the anthropomorphic capabilities of personal assistants. Yet existing dialogue policy approaches often overlook individual personalities because obtaining explicit user profiles is costly and time-consuming. In this article, we propose a personalized dialogue policy learning framework, named PDL. It dynamically learns implicit user profiles from successful dialogue trajectories. Specifically, we collect a lot of success histories from human–computer interactions to extract sequences of user belief states and agent actions. The extracted sequences are processed via a loop clipping operation and modeled with an autoregressive transformer to mimic human analytical behavior. After that, a new user’s latent personalized preferences are predicted based on the autoregressive transformer model. The personalized preferences are employed to implement dialogue policies via three categories of reinforcement learning algorithms, including value-based approaches, policy-based approaches, and model-based approaches. The experiments are conducted on three different task-oriented dialogue datasets, and the results show that the proposed PDL framework achieves state-of-the-art results compared to other comparative approaches.
Keyword:
Deep reinforcement learning
dialogue policy learning
human–agent interaction
personalized agent

期刊

IEEE Transactions on Human-Machine Systems 封面图
IEEE Transactions on Human-Machine Systems
IF:
4.4
论文数:
1.1K
被引数:
3.5K

机构

H
huya inc.
学者数:
1
论文数: 1
被引数: 0
G
guangdong polytechnic normal university
学者数:
658
论文数: 318
被引数: 0
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Human-level control through deep reinforcement learning通过深度强化学习实现人类层面的控制
err2015-02-25
err0
PREAI
errVolodymyr Mnih; Koray Kavukcuoglu; David Silver; Andrei A. Rusu; Joel Veness; Marc G. Bellemare; Alex Graves; Martin Riedmiller; Andreas K. Fidjeland; Georg Ostrovski; Stig Petersen; Charles Beattie; Amir Sadik; Ioannis Antonoglou; Helen King; Dharshan Kumaran; Daan Wierstra; Shane Legg; Demis Hassabis
err分享
err收藏
学者 查看更多内容