arrow
返回

Automatic Robot Hand-Eye Calibration Enabled by Learning-Based 3D Vision

delete2024-09-05
delete0
delete
OA
AI
L
Leihui Li
X
Xingyu Yang
R
Riwei Wang
X
Xuping Zhang *
DOI:10.1007/s10846-024-02166-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hand-eye calibration, a fundamental task in vision-based robotic systems, is commonly equipped with collaborative robots, especially for robotic applications in small and medium-sized enterprises (SMEs). Most approaches to hand-eye calibration rely on external markers or human assistance. We proposed a novel methodology that addresses the hand-eye calibration problem using the robot base as a reference, eliminating the need for external calibration objects or human intervention. Using point clouds of the robot base, a transformation matrix from the coordinate frame of the camera to the robot base is established as I=AXB. To this end, we exploit learning-based 3D detection and registration algorithms to estimate the location and orientation of the robot base. The robustness and accuracy of the method are quantified by ground-truth-based evaluation, and the accuracy result is compared with other 3D vision-based calibration methods. To assess the feasibility of our methodology, we carried out experiments utilizing a low-cost structured light scanner across varying joint configurations and groups of experiments. The proposed hand-eye calibration method achieved a translation deviation of 0.930 mm and a rotation deviation of 0.265 degrees according to the experimental results. Additionally, the 3D reconstruction experiments demonstrated a rotation error of 0.994 degrees and a position error of 1.697 mm. Moreover, our method offers the potential to be completed in 1 second, which is the fastest compared to other 3D hand-eye calibration methods. We conduct indoor 3D reconstruction and robotic grasping experiments based on our hand-eye calibration method. Related code is released at https://github.com/leihui6/LRBO.
Keyword:
Hand-eye calibration
3D Registration
3D Detection
Point cloud
3D Reconstruction

期刊

J
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS
IF:
2.8
论文数:
3.9K
被引数:
6.9K

机构

A
Aarhus University
学者数:
4.3W
论文数: 4.2W
被引数: 4.8W
W
Wenzhou University of Technology
学者数:
476
论文数: 455
被引数: 367
引用论文

引用论文

[Ni(bpy)(ox)]: a candidate in the class of Haldane gap systems (bpy = 2,2ʹ-bipyridine, ox = oxalate)
err2015-07-09
err0
PREAI
errJ. Černák; N. Farkašová; M. Tomás; V. Kavečanský; E. Čižmár; M. Orendáč
err分享
err收藏
The myeloma cell antigen syndecan‐1 is lost by apoptotic myeloma cells
err2001-12-25
err0
errOAAI
errMichel Jourdan; Martine Ferlin; Eric Legouffe; Mira Horvathova; Janny Liautard; Jean FranÇois Rossi; John Wijdenes; Jean Brochier; Bernard Klein
err分享
err收藏
Subversion of Autophagy in Adherent Invasive Escherichia coli-Infected Neutrophils Induces Inflammation and Cell Death
err2012-12-14
err0
errOAAI
errAbderrahman Chargui; Annabelle Cesaro; Sanda Mimouna; Mohamed Fareh; Patrick Brest; Philippe Naquet; Arlette Darfeuille-Michaud; Xavier Hébuterne; Baharia Mograbi; Valérie Vouret-Craviari; Paul Hofman
err分享
err收藏
Genetic variants in lncRNA SRA and risk of breast cancer
err2016-03-08
err0
errOAAI
errRui Yan; Kaijuan Wang; Rui Peng; Shuaibing Wang; Jingjing Cao; Peng Wang; Chunhua Song
err分享
err收藏
err分享
err收藏
A robot hand-eye calibration method of line laser sensor based on 3D reconstruction
err2021-10-01
err66
PREAI
errLi, Mingyang; Du, Zhijiang; Ma, Xiaoxing; Dong, Wei; Gao, Yongzhuo
err分享
err收藏
学者 查看更多内容