.png){kind=icon}
返回
Interactive Semantic Map Representation for Skill-Based Visual Object Navigation
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3380450.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual object navigation is one of the key tasks in mobile robotics. One of the most important components of this task is the accurate semantic representation of the scene, which is needed to determine and reach a goal object. This paper introduces a new representation of a scene semantic map formed during the embodied agent interaction with the indoor environment. It is based on a neural network method that adjusts the weights of the segmentation model with backpropagation of the predicted fusion loss values during inference on a regular (backward) or delayed (forward) image sequence. We implement this representation into a full-fledged navigation approach called SkillTron. The method can select robot skills from end-to-end policies based on reinforcement learning and classic map-based planning methods. The proposed approach makes it possible to form both intermediate goals for robot exploration and the final goal for object navigation. We conduct intensive experiments with the proposed approach in the Habitat environment, demonstrating its significant superiority over state-of-the-art approaches in terms of navigation quality metrics. The developed code and custom datasets are publicly available at github.com/AIRI-Institute/ skill-fusion.
Keyword:
Semantics
Navigation
Task analysis
Robots
Visualization
Planning
Habitats
Reinforcement learning
Mobile robots
Interactive systems
Semantic map
navigation
robotics
reinforcement learning
frontier-based exploration
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
分享收藏Performance of sweeping gas membrane distillation for treating produced water: Modeling and experiments.png)
Desalination
OAAI
DesalinationIF0
OAAI分享收藏Does it take older adults longer than younger adults to perceptually segregate a speech target from a background masker?在感知上将语音目标与背景掩蔽器隔离开来是否需要老年人比年轻人更长的时间？
PREAI
分享收藏分享收藏
查看更多内容