.png){kind=icon}
.png){kind=icon}
Return
A Reinforcement Learning Method Using Multifunctional Principal Component Analysis for Human-Like Grasping
.png){kind=icon}
PRE
AI
DOI：10.1109/TCDS.2020.2988641.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Postural synergies allow a rich set of hand configurations to be represented in lower dimension space compared to the original joint space. In our previous works, we have shown that this can be extended to trajectories thanks to the multivariate functional principal component analysis, obtaining a set of basis functions able to represent grasping movements learned from human demonstration. In this article, we introduce a human cognition-inspired approach for generalizing and improving robot grasping skills in this motion synergies subspace. The use of a reinforcement learning (RL) algorithm allows the robot to explore the surrounding space and improve its capability to reach and grasp objects. The learning method is the policy improvement with path integrals, running in the policy space. Bootstrapped with synergy coefficients obtained from neural networks, the policy reward is based on a force closure grasp quality index computed at the end of the task, measuring how a firm is the grip. We finally show that combining neural networks and RL allows the robot manipulator to have a good initial estimate of the grasping configuration and faster convergence to an optimal grasp with respect to a database approach, the latter a less general solution in presence of new objects.
Keywords:
Grasping
Robot kinematics
Task analysis
Manipulators
Multi-layer neural network
Cognitive robotics
robot learning
semisupervised learning
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
4.9
Papers:
1.0K
Citations:
3.5K