arrow
返回

Visual semantic navigation with real robots

delete2024-12-23
delete0
PRE
AI
C
Carlos Gutiérrez-Álvarez *
P
Pablo Ríos-Navarro
R
Rafael Flor-Rodríguez-Rabadán
F
Francisco Javier Acevedo-Rodríguez
R
Roberto J. López-Sastre
DOI:10.1007/s10489-024-06115-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Visual Semantic Navigation (VSN) is the ability of a robot to learn visual semantic information for navigating in unseen environments. These VSN models are typically tested in those virtual environments where they are trained, mainly using reinforcement learning based approaches. Therefore, we do not yet have an in-depth analysis of how these models would behave in the real world. In this work, we propose a new solution to integrate VSN models into real robots, so that we have true embodied agents. We also release a novel ROS-based framework for VSN, ROS4VSN, so that any VSN-model can be easily deployed in any ROS-compatible robot and tested in a real setting. Our experiments with two different robots, where we have embedded two state-of-the-art VSN agents, confirm that there is a noticeable performance difference of these VSN solutions when tested in real-world and simulation environments. We hope that this research will endeavor to provide a foundation for addressing this consequential issue, with the ultimate aim of advancing the performance and efficiency of embodied agents within authentic real-world scenarios. Code to reproduce all our experiments can be found at https://github.com/gramuah/ros4vsn.
Keyword:
Robotics
Embodied agents
Vision-based navigation
Artificial intelligence
Reinforcement learning

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

U
Universidad Rey Juan Carlos
学者数:
6.2K
论文数: 6.2K
被引数: 6.7K
U
universidad de alcala
学者数:
7.9K
论文数: 6.8K
被引数: 7
引用论文

引用论文

Guidance for Estimating Airport Construction Emissions
err
IF0
err2014-02-05
err0
PREAI
errBrian Kim; Kazumi Nakada; John Trendowski; Mary Vigilante; Virginia Raps; Adrian Jones; David Stonefield
err分享
err收藏
Learning agile and dynamic motor skills for legged robots
err2019-01-30
err795
errOAAI
errHwangbo, Jemin; Lee, Joonho; Dosovitskiy, Alexey; Bellicoso, Dario; Tsounis, Vassilios; Koltun, Vladlen; Hutter, Marco
err分享
err收藏
Navigating to objects in the real world导航到现实世界中的对象
err2023-06-28
err22
errOAAI
errGervet, Theophile; Chintala, Soumith; Batra, Dhruv; Malik, Jitendra; Chaplot, Devendra Singh
err分享
err收藏
Robust Monte Carlo localization for mobile robots
err2001-05-01
err1.2K
errOAAI
errThrun, S; Fox, D; Burgard, W; Dellaert, F
err分享
err收藏
Synthesis and stability of mixed nonfluorinated 1,1,1-trihalo-alkanes
err2006-01-01
err0
PREAI
errCosme G. Francisco; Concepción C. González; Alan R. Kennedy; Nieves R. Paz; Ernesto Suárez
err分享
err收藏
err分享
err收藏
学者 查看更多内容