arrow
Return

Knowledge guided deep deterministic policy gradient

delete2025-02-01
delete0
PRE
AI
P
Peng Qin
赵
赵涛 (Tao Zhao) *
DOI:10.1016/j.knosys.2025.113087delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep deterministic policy gradient (DDPG) exhibits excellent handling capabilities for complex regulation and control problems with continuous state and action spaces. However, its trial-and-error interaction and learning from scratch require extensive exploration by the agent, leading to low learning efficiency and even non-convergence in sparse reward environments. To fully utilize knowledge during the learning process to improve efficiency and performance, this paper draws inspiration from human learning methods and proposes a semantic knowledge-guided DDPG (KGDDPG) approach. In terms of knowledge representation, considering the fuzziness and precision of semantic knowledge, a knowledge system based on a rule framework combining precise propositions and fuzzy propositions is constructed. In terms of knowledge integration, to reduce the randomness of exploration, a knowledge-guided action strategy based on stacked generalization is proposed. Furthermore, a supervised-then-reinforced learning method is employed: the supervised phase quickly incorporates prior knowledge to accelerate learning, while the reinforced phase refines the policy network to overcome the limitations of relying solely on prior knowledge. Finally, experiments were conducted using a mapless navigation task for mobile robots to verify the effectiveness and practical feasibility of the method.
Keywords:
Knowledge guide
Fuzzy system
Mapless navigation
DDPG

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

No organization information available
Cited Papers

Cited Papers

SADRL: Merging human experience with machine intelligence via supervised assisted deep reinforcement learning
err2022-01-01
err12
PREAI
errLi, Xiaoshuang; Wang, Xiao; Zheng, Xinhu; Jin, Junchen; Huang, Yanhao; Zhang, Jun Jason; Wang, Fei-Yue
errShare
errSave
MSN: Mapless Short-Range Navigation Based on Time Critical Deep Reinforcement Learning
err2023-08-01
err9
PREAI
errLi, Bohan; Huang, Zhelong; Chen, Tony Weitong; Dai, Tianlun; Zang, Yalei; Xie, Wenbin; Tian, Bo; Cai, Ken
errShare
errSave
Exploration in deep reinforcement learning: A survey
err2022-09-01
err138
errOAAI
errLadosz, Pawel; Weng, Lilian; Kim, Minwoo; Oh, Hyondong
errShare
errSave
researcher View more