arrow
Return

Skill enhancement learning with knowledge distillation

delete2024-07-22
delete0
PRE
AI
N
Naijun Liu
F
Fuchun Sun *
B
Bin Fang
刘华坪 cover
刘华坪 (Huaping Liu)
DOI:10.1007/s11432-023-4016-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Skill learning through reinforcement learning has significantly progressed in recent years. However, it often struggles to efficiently find optimal or near-optimal policies due to the inherent trial-and-error exploration in reinforcement learning. Although algorithms have been proposed to enhance skill learning efficacy, there is still much room for improvement in terms of skill learning performance and training stability. In this paper, we propose an algorithm called skill enhancement learning with knowledge distillation (SELKD), which integrates multiple actors and multiple critics for skill learning. SELKD employs knowledge distillation to establish a mutual learning mechanism among actors. To mitigate critic overestimation bias, we introduce a novel target value calculation method. We also perform theoretical analysis to ensure the convergence of SELKD. Finally, experiments are conducted on several continuous control tasks, illustrating the effectiveness of the proposed algorithm.
Keywords:
skill learning
enhancement learning
reinforcement learning
knowledge distillation

Journal

Science China Information Sciences cover
Science China Information Sciences
IF:
7.6
Papers:
4.9K
Citations:
8.9K

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137