.png){kind=icon}
返回
Attribute-Based Robotic Grasping With Data-Efficient Adaptation
.png){kind=icon}
OA
AI
DOI：10.1109/TRO.2024.3353484.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Robotic grasping is one of the most fundamental robotic manipulation tasks and has been the subject of extensive research. However, swiftly teaching a robot to grasp a novel target object in clutter remains challenging. This article attempts to address the challenge by leveraging object attributes that facilitate recognition, grasping, and rapid adaptation to new domains. In this work, we present an end-to-end encoder-decoder network to learn attribute-based robotic grasping with data-efficient adaptation capability. We first pretrain the end-to-end model with a variety of basic objects to learn generic attribute representation for recognition and grasping. Our approach fuses the embeddings of a workspace image and a query text using a gated-attention mechanism and learns to predict instance grasping affordances. To train the joint embedding space of visual and textual attributes, the robot utilizes object persistence before and after grasping. Our model is self-supervised in a simulation that only uses basic objects of various colors and shapes but generalizes to novel objects in new environments. To further facilitate generalization, we propose two adaptation methods, adversarial adaption and one-grasp adaptation. Adversarial adaptation regulates the image encoder using augmented data of unlabeled images, whereas one-grasp adaptation updates the overall end-to-end model using augmented data from one grasp trial. Both adaptation methods are data-efficient and considerably improve instance grasping performance. Experimental results in both simulation and the real world demonstrate that our approach achieves over 81% instance grasping success rate on unknown objects, which outperforms several baselines by large margins.
Keyword:
Deep learning in grasping and manipulation
grasping
perception for grasping and manipulation
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
暂无机构信息
引用论文
Visuomotor perimetry in fish: A new approach to the functional analysis of altered visual pathways鱼的视觉运动视野检查: 一种对改变的视觉通路进行功能分析的新方法
PREAI
分享收藏Substrate specificity and inhibitor analyses of human steroid 5β-reductase (AKR1D1)人类类固醇5 β-还原酶 (AKR1D1) 的底物特异性和抑制剂分析.png)
Steroids
OAAI
SteroidsIF0
OAAI分享收藏分享收藏Structure and Enzymatic Properties of an Unusual Cysteine Tryptophylquinone-Dependent Glycine Oxidase from Pseudoalteromonas luteoviolaceaBiochemistryOAAI
BiochemistryIF0
OAAI分享收藏Study on the Grayscale Characteristics of Borehole Images of Progressive Failure of Coal Bodies with Different Moisture ContentsProcessesOAAI
ProcessesIF0
OAAI分享收藏
查看更多内容