.png){kind=icon}
返回
Target-Driven Visual Navigation by Using Causal Intervention
.png){kind=icon}
PRE
AI
DOI：10.1109/TIV.2023.3288810.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Target-driven visual navigation presents great potentials in scientific and industrial fields. It takes the target and environment observations as input. However, during training, we found that the agent sometimes got stuck in specific locations. Based on the analysis on visual information from a novel causal perspective, one of the most critical hurdles is the neglect of confounders in environments, which often leads to spurious correlations. Mitigating the confounding effect helps to discover the real causality and therefore are taken into consideration in other fields such as object detection. In this article, we propose Causal Intervention Visual Navigation (CIVN), based on deep reinforcement learning (DRL) and causal intervention. We realize causal intervention using front-door adjustment as most confounders are hard to model explicitly. Specifically, CIVN is implemented by Causal Attention, which is a reasonable approximation of causal intervention for visual navigation. Causal attention provides high-quality representation, which is leveraged by DRL and reduces the number of stuck. It is worth mentioned that causal intervention is for the first time applied by us in solving the confounding effect in target-driven visual navigation. Extensive experiments on AI2-THOR demonstrate that CIVN achieves better performance than prior arts. Specifically, the generalization for unknown targets and scenes is improved by a large margin, which is a basic research topic in visual navigation. Moreover, to obtain better generalization, we propose a novel experiment utilizing pre-trained models firstly.
Keyword:
Visualization
Navigation
Training
Correlation
Task analysis
Reinforcement learning
Context modeling
Target-driven visual navigation
causal intervention
front-door adjustment
causal attention
generalization
期刊
I
IF:
14.3
论文数:
1.3K
被引数:
1.2W
机构
引用论文
.png){kind=icon}
Semiglobal Consensus of a Class of Heterogeneous Multi-Agent Systems With Saturation一类饱和异质多智能体系统的半全局一致性
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏
查看更多内容