arrow
Return

Image-Based Visual Servoing System for Components Alignment Using Point and Line Features

delete2022-01-01
delete13
PRE
AI
S
Shaohua Yan
陶显 (Xian Tao)
徐德 (De Xu) *
DOI:10.1109/TIM.2022.3165794delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The design of visual servoing system for robotic high-precision assembly is of great challenge. For the difficulty of insufficient accuracy of target object feature extraction, a deep neural network combined with feature pyramid network (FPN) structure is proposed. This lightweight network requires only a small amount of labeled data to achieve significant segmentation results. The control laws of translation and orientation for component alignment are separately designed. The translation is controlled based on the interaction matrix of point features. The orientation is controlled based on the interaction matrix of line features. The relations between the cameras' motion and the end-effector of the manipulator are calibrated via the manipulator's active movements, which are 3 x 3 transformation matrices. The depth information of feature points is integrated into the transformation matrix. The alignment pose error estimation is realized with the interaction matrices, transformation matrices, and point and line features. A robotic assembly system is developed to assemble two aviation circular connectors with six degree-of-freedoms (DOFs) in high precision in 3-D space. The experimental results verify the effectiveness of the proposed method.
Keywords:
Deep neural network
feature extraction
image-based visual servoing
interaction matrix
pose error estimation
robotic assembly system

Journal

IEEE Transactions on Instrumentation and Measurement cover
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
Papers:
1.9W
Citations:
5.8W

Organization

C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704