arrow
返回

Objects Relocation in Clutter with Robot Manipulators via Tree-based Q-Learning Algorithm: Analysis and Experiments

delete2022-10-07
delete1
PRE
AI
G
Giacomo Golluccio *
P
Paolo Di Lillo
D
Daniele Di Vito
A
Alessandro Marino
G
Gianluca Antonelli
DOI:10.1007/s10846-022-01719-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This work addresses the problem of retrieving a target object from cluttered environment using a robot manipulator. In the details, the proposed solution relies on a Task and Motion Planning approach based on a two-level architecture: the high-level is a Task Planner aimed at finding the optimal objects sequence to relocate, according to a metric based on the objects weight; the low-level is a Motion Planner in charge of planning the end-effector path for reaching the specific objects taking into account the robot physical constraints. The high-level task planner is a Reinforcement Learning agent, trained using the information coming from the low-level Motion Planner. In this work we consider the Q-Tree algorithm, which is based on a dynamic tree structure inspired by the Q-learning technique. Three different RL-policies with two kinds of tree exploration techniques (Breadth and Depth) are compared in simulation scenarios with different complexity. Moreover, the proposed learning methods are experimentally validated in a real scenario by adopting a KINOVA Jaco(2) 7-DoFs robot manipulator.
Keyword:
Motion planning
Task planning
Reinforcement learning

期刊

J
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS
IF:
2.8
论文数:
3.9K
被引数:
6.9K

机构

U
university of cassino
学者数:
1.8K
论文数: 1.8K
被引数: 1
引用论文

引用论文

Refined crystal structures of subtilisin Novo in complex with wild-type and two mutant eglins
err1991-01-01
err0
PREAI
errD.W. Heinz; J.P. Priestle; J. Rahuel; K.S. Wilson; M.G. Grütter
err分享
err收藏
err分享
err收藏
Orbital meningeal melanocytoma: Histological, immunohistochemical and molecular characterization of a case and review of the literature
err2016-10-01
err0
PREAI
errAndrea Palicelli; Maria Giulia Disanto; Gabriele Panzarasa; Claudia Veggiani; Gabriella Galizia; Stefano Dal Cin; Elisa Gruppioni; Renzo Boldorini
err分享
err收藏
学者 查看更多内容