.png){kind=icon}
返回
Object Detection Using Sim2Real Domain Randomization for Robotic Applications
.png){kind=icon}
OA
AI
DOI：10.1109/TRO.2022.3207619.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Robots working in unstructured environments must be capable of sensing and interpreting their surroundings. One of the main obstacles of deep-learning-based models in the field of robotics is the lack of domain-specific labeled data for different industrial applications. In this article, we propose a sim2real transfer learning method based on domain randomization for object detection with which labeled synthetic datasets of arbitrary size and object types can be automatically generated. Subsequently, a state-of-the-art convolutional neural network, YOLOv4, is trained to detect the different types of industrial objects. With the proposed domain randomization method, we could shrink the reality gap to a satisfactory level, achieving 86.32% and 97.38% mAP(50) scores, respectively, in the case of zero-shot and one-shot transfers, on our manually annotated dataset containing 190 real images. Our solution fits for industrial use as the data generation process takes less than 0.5 s per image and the training lasts only around 12 h, on a GeForce RTX 2080 Ti GPU. Furthermore, it can reliably differentiate similar classes of objects by having access to only one real image for training. To our best knowledge, this is the only work thus far satisfying these constraints.
Keyword:
Computer vision for automation
deep learning in robotics and automation
localization
sim2real knowledge transfer
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
引用论文
Influence of duration of focal cerebral ischemia and neuronal nitric oxide synthase on translocation of apoptosis-inducing factor to the nucleus.png)
Neuroscience
OAAI
NeuroscienceIF0
OAAI分享收藏Types of Parent Verbal Responsiveness That Predict Language in Young Children With Autism Spectrum Disorder预测自闭症谱系障碍幼儿语言的父母言语反应类型OAAI
OAAI分享收藏Determinants of quality of life in patients with fibromyalgia: A structural equation modeling approach纤维肌痛患者生活质量的决定因素: 结构方程建模方法PLOS ONEOAAI
PLOS ONEIF0
OAAI分享收藏
查看更多内容