arrow
返回

Instance-level 6D pose estimation based on multi-task parameter sharing for robotic grasping

delete2024-04-02
delete1
delete
OA
AI
张
张黎明 (Liming Zhang)
X
Xin Zhou
J
Jiaqing Liu
C
Can Wang *
X
Xinyu Wu
DOI:10.1038/s41598-024-58590-xdelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Six-dimensional pose estimation task predicts its 3D rotation matrix and 3D translation matrix in the world coordinate system by inputting the color image or depth image of the target object. Existing methods usually use deep neural networks to directly predict or regress object poses based on keypoint methods. The prediction results usually have deviations depending on whether the surface shape of the object is prominent or not and the size of the object. To solve this problem, we propose the six-dimensional pose estimation based on multi-task parameter sharing (PMP) framework to incorporate object category information into the pose estimation network through the form of an object classification auxiliary task. First, we extract the image features and point cloud features of the target object separately, and fuse them point by point; then, we share the confidence of each keypoint in pose estimation task and the knowledge of the classification task, get the key points with higher confidence, and predict the object pose; finally, the obtained object pose is passed through an iterative optimization network to obtain the final pose. The experimental results on the LineMOD dataset show that the proposed method can improve the accuracy of pose estimation and narrow the gap in the prediction accuracy of objects with different shapes. We also tested on a new dataset of small-scale objects, which contains object RGBD images and accurate 3D point cloud information. The proposed method is applied to the grasping experiment on the UR5 robotic arm, which satisfies the real-time pose estimation results during the grasping process.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Scientific Reports 封面图
Scientific Reports
IF:
3.9
论文数:
28.3W
被引数:
108.8W

机构

中
中国科学院
学者数:
2.3W
论文数: 6.1K
被引数: 39.1W
引用论文

引用论文

Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Antiferromagnetic ruthenium(III)反铁磁性钌 (III)
err2002-05-01
err0
PREAI
errRichard L. Carlin; Ramon Burriel; Kenneth R. Seddon; Russell I. Crisp
err分享
err收藏
Pallidal Neurostimulation and Capsulotomy for Malignant Tourette's Syndrome
err2019-04-05
err0
errOAAI
errChencheng Zhang; Hongxia Li; Yixin Pan; Haiyan Jin; Bomin Sun; Yiwen Wu; Li Dianyou
err分享
err收藏
Therapeutic response to prednisone in relation to age in polymyalgia rheumatica: a comparison study
err2018-01-29
err0
PREAI
errAline Charpentier; Frank Verhoeven; Maxime Sondag; Xavier Guillot; Clément Prati; Daniel Wendling
err分享
err收藏
学者 查看更多内容