arrow
Return

Sample-efficient reinforcement learning with symmetry-guided demonstrations for robotic manipulation

delete2026-01-28
delete0
PRE
AI
A
Amir M. Soufi Enayati
Z
Zengjie Zhang
K
Kashish Gupta
H
Homayoun Najjaran *
DOI:10.1007/s00521-025-11733-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Reinforcement learning (RL) suffers from low sample efficiency, particularly in high-dimensional continuous state-action spaces of complex robotic manipulation tasks. RL performance can improve by leveraging prior knowledge, even when demonstrations are limited and collected from simplified environments. To address this, we define General Abstract Symmetry (GAS) for aggregating demonstrations from symmetrical abstract partitions of the robot environment. We introduce Demo-EASE, a novel training framework using a dual-buffer architecture that stores both demonstrations and RL-generated experiences. Demo-EASE improves sample efficiency through symmetry-guided demonstrations and behavior cloning, enabling strong initialization and balanced exploration-exploitation. Demo-EASE is compatible with both on-policy and off-policy RL algorithms, supporting various training regimes. We evaluate our framework in three simulation experiments using a Kinova® Gen3 robot with joint-space control within PyBullet. Our results show that Demo-EASE significantly accelerates convergence and improves final performance compared to standard RL baselines, demonstrating its potential for efficient real-world robotic manipulation learning.
Keywords:
Reinforcement learning
Manipulation
Motion planning
Symmetry
Abstraction
Learning from demonstration
Behavior cloning
Data aggregation

Journal

Neural Computing and Applications cover
Neural Computing and Applications
IF:
4.5
Papers:
816
Citations:
3.2W

Organization

D
Department of Electrical Engineering
Scholars:
115
Papers: 59
Citations: 9
D
department of mechanical engineering
Scholars:
4.2K
Papers: 2.1K
Citations: 1