arrow
返回

Knowledge guided fuzzy deep reinforcement learning

delete2025-03-01
delete0
PRE
AI
P
Peng Qin
赵
赵涛 (Tao Zhao) *
DOI:10.1016/j.eswa.2024.125823delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reinforcement learning (RL) addresses complex sequential decision-making problems through interactive trial- and-error and the handling of delayed rewards. However, reinforcement learning typically starts from scratch, necessitating extensive exploration, which results in low learning efficiency. In contrast, humans often leverage prior knowledge to learn. Inspired by this, this paper proposes a semantic knowledge-guided reinforcement learning method (KFDQN), which fully utilizes knowledge to influence reinforcement learning, thereby improving learning efficiency, training stability, and performance. In terms of knowledge representation, considering the strong fuzziness of semantic knowledge, a fuzzy system is constructed to represent this knowledge. In terms of knowledge integration, a knowledge-guided framework that integrates a hybrid action selection strategy (HYAS), a hybrid learning method (HYL), and knowledge updating is constructed in conjunction with the existing reinforcement learning framework. The HYAS integrates knowledge into action selection, reducing the randomness of traditional exploration methods. The HYL incorporates knowledge into the learning target, thereby reducing uncertainty in the learning objective. Knowledge updating ensures that new data is utilized to update knowledge, avoiding the negative impact of knowledge limitations on the learning process. The algorithm is validated through numerical tasks in OpenAI Gym and real-world mobile robot Goal Reach and obstacle avoidance tasks. The results confirm that the algorithm effectively combines knowledge and reinforcement learning, resulting in a 28.6% improvement in learning efficiency, a 19.56% enhancement in performance, and increased training stability.
Keyword:
Knowledge guide
Fuzzy system
Reinforcement learning
Deep Q-network

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
引用论文

引用论文

Fuzzy sets模糊集
err1965-06-01
err0
errOAAI
errL.A. Zadeh
err分享
err收藏
SADRL: Merging human experience with machine intelligence via supervised assisted deep reinforcement learning
err2022-01-01
err12
PREAI
errLi, Xiaoshuang; Wang, Xiao; Zheng, Xinhu; Jin, Junchen; Huang, Yanhao; Zhang, Jun Jason; Wang, Fei-Yue
err分享
err收藏
Keystroke dynamics authentication for mobile phones
err2011-03-21
err0
PREAI
errEmanuele Maiorana; Patrizio Campisi; Noelia González-Carballo; Alessandro Neri
err分享
err收藏
Shopping addiction: A brief review.
err2021-09-01
err0
PREAI
errDaryl Wayne Niedermoser; Sylvie Petitjean; Nina Schweinfurth; Lena Wirz; Vivien Ankli; Hannah Schilling; Claudia Zueger; Martin Meyer; Renanto Poespodihardjo; Gerhard Wiesbeck; Marc Walter
err分享
err收藏
Guided Reinforcement Learning A Review and Evaluation for Efficient and Effective Real-World Robotics
err2023-06-01
err8
errOAAI
errEsser, Julian; Bach, Nicolas; Jestel, Christian; Urbann, Oliver; Kerner, Soren
err分享
err收藏
学者 查看更多内容