arrow
Return

An Intelligence Image Processing Method of Visual Servo System in Complex Environment

delete2022-09-15
delete4
PRE
AI
李世鹏 cover
李世鹏 (Shipeng Li)
D
Di Li
C
Chunhua Zhang *
J
Juan Wang
DOI:10.1109/JSEN.2020.3040288delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In robot visual servoing system, effective detected the region of interest area (ROI) in target images is the first problem should be solved, but the detection is susceptible to an unstructured environment. In this paper, an instance segmentation network algorithm based on Mask Region Convolutional Neural Networks (Mask R-CNN) framework is proposed for ROI image preprocessing. As instance segmentation technology can distinguish complex environmental information, so first with this advantage filter out message such as shape or similar area to target image, then with semantic segmentation technology add special category labels to the filtered images and distinguish different individual instances in similar categories. Finally through the series steps aforementioned, robot vision system can overcome the impact of environmental factors and identify the target image. The proposed method is used to detect target image under five constraints such as occlusion and reflection, result shows the algorithm can effectively deal with challenges that brought by complex constraints, and even can predict the location data of missing information based on some image information. In addition, based on the algorithm proposed in this paper, we used one seven axis robot visual servo platform, executed visual servoing experiment under different unstructured environments, further verifies the effectiveness of our proposed method.
Keywords:
Visual servoing
robot control
image preprocessing
Mask R-CNN
instance segmentation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Sensors Journal cover
IEEE Sensors Journal
IF:
4.5
Papers:
2.2W
Citations:
7.3W

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Novel Analysis of Immune Cells from Nasal Microbiopsy Demonstrates Reliable, Reproducible Data for Immune Populations, and Superior Cytokine Detection Compared to Nasal Wash
err2017-01-20
err0
errOAAI
errSimon P. Jochems; Katherine Piddock; Jamie Rylance; Hugh Adler; Beatriz F. Carniel; Andrea Collins; Jenna F. Gritzfeld; Carole Hancock; Helen Hill; Jesus Reiné; Alexandra Seddon; Carla Solórzano; Syba Sunny; Ashleigh Trimble; Angela D. Wright; Seher Zaidi; Stephen B. Gordon; Daniela M. Ferreira
errShare
errSave
Viosual servo control - Part I: Basic approaches
err2006-12-01
err1.9K
errOAAI
errChaumette, Francois; Hutchinson, Seth
errShare
errSave
errShare
errSave
researcher View more