arrow
返回

Dynamic preference inference network: Improving sample efficiency for multi-objective reinforcement learning by preference estimation

delete2024-11-01
delete0
PRE
AI
Y
Yang Liu
Y
Ying Zhou
Z
Ziming He
J
Jingchen Li *
DOI:10.1016/j.knosys.2024.112512delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-objective reinforcement learning (MORL) addresses the challenge of optimizing policies in environments with multiple conflicting objectives. Traditional approaches often rely on scalar utility functions, which require predefined preference weights, limiting their adaptability and efficiency. To overcome this, we propose the Dynamic Preference Inference Network (DPIN), a novel method designed to enhance sample efficiency by dynamically estimating the trajectory decision preference of the agent. DPIN leverages a neural network to predict the most favorable preference distribution for each trajectory, enabling more effective policy updates and improving overall performance in complex MORL tasks. Extensive experiments in various benchmark environments demonstrate that DPIN significantly outperforms existing state-of-the-art methods, achieving higher scalarized returns and hypervolume. Our findings highlight DPIN's ability to adapt to varying preferences, reduce sample complexity, and provide robust solutions in multi-objective settings.
Keyword:
Multi-objective reinforcement learning
Sample efficiency
Reinforcement learning

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
B
beijing academy of agriculture & forestry sciences (baafs)
学者数:
4.2K
论文数: 3.1K
被引数: 6
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

Multi-Objective Reinforcement Learning Based Healthcare Expansion Planning Considering Pandemic Events
err2023-06-01
err6
errOAAI
errShuvo, Salman Sadiq; Symum, Hasan; Ahmed, Md Rubel; Yilmaz, Yasin; Zayas-Castro, Jose L. L.
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
Special issue on multi-objective reinforcement learning
err2017-11-01
err9
errOAAI
errDrugan, Madalina; Wiering, Marco; Vamplew, Peter; Chetty, Madhu
err分享
err收藏
err分享
err收藏
学者 查看更多内容