.png){kind=icon}
返回
Memory-Adaptive Vision-and-Language Navigation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2024.110511.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Vision -and -Language Navigation (VLN) requests an agent to navigate in 3D environments following given instructions, where history is critical for decision -making in dynamic navigation process. Particularly, a memory bank storing histories is widely used in existing methods to incorporate with multimodel representations in current scenes for better decision -making. However, by weighting each history with a simple scalar, those methods cannot purely utilize the informative cues that co -exist with detrimental contents in each history, thereby inevitably introducing noises into decision -making. To that end, we propose a novel Memory -Adaptive Model (MAM) that can dynamically restrain the detrimental contents in histories for retaining contents that benefit navigation only. Specifically, two key modules, Visual and Textual Adaptive Modules, are designed to restrain history noises based on scene -related vision and text, respectively. A Reliability Estimator Module is further introduced to refine above adaptation operations. Our experiments on the widely used RxR and R2R datasets show that MAM outperforms its baseline method by 4.0% / 2.5% and 2% / 1% on the validation unseen/test split, respectively, wrt the SR metric.
Keyword:
Vision-and-Language Navigation
Memory bank
History noises
Memory-Adaptive Model
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
Blockchain-based Supply Chain for the Automation of Transaction Process: Case Study based Validation
PREAI
分享收藏
分享收藏
查看更多内容