arrow
返回

Visual Hindsight Self-Imitation Learning for Interactive Navigation

delete2024-01-01
delete1
delete
OA
AI
K
K. M. Kim
M
Moonhoen Lee
M
Min Whoo Lee
K
Kisung Shin
M
Minsu Lee
B
Byoung‐Tak Zhang *
DOI:10.1109/ACCESS.2024.3413864delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Interactive visual navigation tasks, which involve following instructions to reach and interact with specific targets, are challenging not only because successful experiences are very rare but also because complex visual inputs require a substantial number of samples. Previous methods for these tasks often rely on intricately designed dense rewards or the use of expensive expert data for imitation learning. To tackle these challenges, we propose a novel approach, Visual Hindsight Self-Imitation Learning (VHS), which enables re-labeling in vision-based and partially observable environments through Prototypical Goal (PG) embedding. We introduce the PG embeddings, which are derived from experienced goal observations, as opposed to handling instructions as word embeddings. This embedding technique allows the agent to visually reinterpret its unsuccessful attempts, enabling vision-based goal re-labeling and self-imitation from enhanced successful experiences. Experimental results show that VHS outperforms existing techniques in interactive visual navigation tasks, confirming its superior performance, sample efficiency, and generalization.
Keyword:
Visualization
Navigation
Task analysis
Reinforcement learning
Robot kinematics
Trajectory
Training
Interactive systems
Visual hindsight
interactive navigation
visual reinforcement learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
引用论文

引用论文

Topographical distribution and morphology of NADPH-diaphorase-stained neurons in the human claustrum
err2014-05-27
err0
errOAAI
errDimka V. Hinova-Palova; Lawrence Edelstein; Boycho Landzhov; Minko Minkov; Lina Malinova; Stanislav Hristov; Frank J. Denaro; Alexandar Alexandrov; Teodora Kiriakova; Ilina Brainova; Adrian Paloff; Wladimir Ovtscharoff
err分享
err收藏
Improved prototypical networks for few-Shot learninge用于少镜头学习的改进原型网络
err2020-12-01
err77
PREAI
errJi, Zhong; Chai, Xingliang; Yu, Yunlong; Pang, Yanwei; Zhang, Zhongfei
err分享
err收藏
Experimental Analysis of the Pool Boiling Phenomenon of Sugarcane Juice
err2015-09-02
err0
PREAI
errDaniel Marcelo; Paul Villar Yacila; Raúl La Madrid Olivares
err分享
err收藏
学者 查看更多内容