.png){kind=icon}
返回
Value Iteration Networks With Gated Summarization Module
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2023.3286729.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this paper, we address the challenges faced by Value Iteration Networks (VIN) in handling larger input maps and mitigating the impact of accumulated errors caused by increased iterations. We propose a novel approach, Value Iteration Networks with Gated Summarization Module (GS-VIN), which incorporates two main improvements: 1) employing an Adaptive Iteration Strategy in the Value Iteration module to reduce the number of iterations; and 2) introducing a Gated Summarization module to summarize the iterative process. The adaptive iteration strategy uses larger convolution kernels with fewer iteration times, reducing network depth and increasing training stability while maintaining the accuracy of the planning process. The gated summarization module enables the network to emphasize the entire planning process, rather than solely relying on the final global planning outcome, by temporally and spatially resampling the entire planning process within the VI module. We conduct experiments on 2D grid world path-finding problems and the Atari Mr. Pac-man environment, demonstrating that GS-VIN outperforms the baseline in terms of single-step accuracy, planning success rate, and overall performance across different map sizes. Additionally, we provide an analysis of the relationship between input size, kernel size, and the number of iterations in VI-based models, which is applicable to a majority of VI-based models and offers valuable insights for researchers and industrial deployment.
Keyword:
Value iteration
deep reinforcement learning
path-finding
robotics
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Does it take older adults longer than younger adults to perceptually segregate a speech target from a background masker?在感知上将语音目标与背景掩蔽器隔离开来是否需要老年人比年轻人更长的时间？
PREAI
分享收藏分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Candidate .gamma.-Secretases in the Generation of the Carboxyl Terminus of the Alzheimer's Disease .beta.A4 Amyloid: Possible Involvement of Cathepsin D候选人。Γ-分泌酶在阿尔茨海默氏病羧基末端的产生。Β.A4淀粉样蛋白: 组织蛋白酶D可能参与.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏
查看更多内容