.png){kind=icon}
返回
Real-Time Instance-Aware Segmentation and Semantic Mapping on Edge Devices
.png){kind=icon}
PRE
AI
DOI：10.1109/TIM.2022.3224512.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Perceiving the environment semantically in real-time is challenging for unmanned aerial vehicles (UAVs) with limited computational resources. In this article, a real-time instance-aware segmentation and semantic mapping method on small edge devices is proposed. Taking red, green, blue, and the depth (RGB-D) image as input, the presented instance segmentation pipeline is able to run at the speed of 38 frames/s on AGX Xavier. To achieve this, we take a lightweight object detection model as the backbone and reformulate the mask generation problem as threshold regression in depth by a novel designed truncation network. After that, a probability grid map is constructed to integrate the categories of voxels and object-level entities. Objects parameterized by pose, extent, category, and point cloud are tracked and fused across frames by data association. Finally, autonomous exploration experiments of UAVs are conducted to demonstrate the effectiveness of the proposed method in both simulation and real-world.
Keyword:
Semantics
Image segmentation
Real-time systems
Feature extraction
Three-dimensional displays
Simultaneous localization and mapping
Image edge detection
Autonomous exploration
instance segmentation
semantic mapping
unmanned aerial vehicles (UAVs)
期刊
IF:
5.9
论文数:
2.0W
被引数:
5.8W
机构
引用论文
.png){kind=icon}
RGB-DI Images and Full Convolution Neural Network-Based Outdoor Scene Understanding for Mobile Robots基于rgb-di图像和全卷积神经网络的移动机器人室外场景理解
OAAI
OAAI分享收藏分享收藏
查看更多内容