arrow
返回

Research on Multi-Object Sorting System Based on Deep Learning

delete2021-09-17
delete8
delete
OA
AI
张鸿雁 封面图
张鸿雁 (Hongyan Zhang)
H
Huawei Liang
T
Tao Ni
L
Lingtao Huang *
杨
杨劲松 (J. N. Yang)
DOI:10.3390/s21186238delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
As a complex task, robot sorting has become a research hotspot. In order to enable robots to perform simple, efficient, stable and accurate sorting operations for stacked multi-objects in unstructured scenes, a robot multi-object sorting system is built in this paper. Firstly, the training model of rotating target detection is constructed, and the placement state of five common objects in unstructured scenes is collected as the training set for training. The trained model is used to obtain the position, rotation angle and category of the target object. Then, the instance segmentation model is constructed, and the same data set is made, and the instance segmentation network model is trained. Then, the optimized Mask R-CNN instance segmentation network is used to segment the object surface pixels, and the upper surface point cloud is extracted to calculate the normal vector. Then, the angle obtained by the normal vector of the upper surface and the rotation target detection network is fused with the normal vector to obtain the attitude of the object. At the same time, the grasping order is calculated according to the average depth of the surface. Finally, after the obtained object posture, category and grasping sequence are fused, the performance of the rotating target detection network, the instance segmentation network and the robot sorting system are tested on the established experimental platform. Based on this system, this paper carried out an experiment on the success rate of object capture in a single network and an integrated network. The experimental results show that the multi-object sorting system based on deep learning proposed in this paper can sort stacked objects efficiently, accurately and stably in unstructured scenes.
Keyword:
robot sorting
rotating target detection
instance segmentation
pose estimation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.3W
被引数:
20.9W

机构

Y
yanshan university
学者数:
1.7K
论文数: 445
被引数: 0
J
Jilin University
学者数:
5.4K
论文数: 1.3K
被引数: 0
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
Robust visual servoing
err2003-10-01
err45
PREAI
errKragic, D; Christensen, HI
err分享
err收藏
err分享
err收藏
学者 查看更多内容