arrow
返回

Pathfinding in stochastic environments: learning vs planning

delete2022-08-18
delete8
delete
OA
AI
A
Alexey Skrynnik *
A
Anton Andreychuk
K
Konstantin Yakovlev
A
Aleksandr I. Panov
DOI:10.7717/peerj-cs.1056delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Among the main challenges associated with navigating a mobile robot in complex environments are partial observability and stochasticity. This work proposes a stochastic formulation of the pathfinding problem, assuming that obstacles of arbitrary shapes may appear and disappear at random moments of time. Moreover, we consider the case when the environment is only partially observable for an agent. We study and evaluate two orthogonal approaches to tackle the problem of reaching the goal under such conditions: planning and learning. Within planning, an agent constantly replans and updates the path based on the history of the observations using a search-based planner. Within learning, an agent asynchronously learns to optimize a policy function using recurrent neural networks (we propose an original efficient, scalable approach). We carry on an extensive empirical evaluation of both approaches that show that the learning-based approach scales better to the increasing number of the unpredictably appearing/disappearing obstacles. At the same time, the planning-based one is preferable when the environment is close-to-the-deterministic (i.e., external disturbances are rare). Code available at https:figithub.comfrviskaronlpathfinding-instochastic-envs.
Keyword:
Reinforcement learning
Path finding
Policy optimization
Stochastic A*
Asynchronous learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

PeerJ Computer Science 封面图
PeerJ Computer Science
IF:
2.5
论文数:
3.4K
被引数:
6.9K

机构

M
moscow institute of physics & technology
学者数:
4.5K
论文数: 3.0K
被引数: 3
R
russian academy of sciences
学者数:
9.1W
论文数: 6.0W
被引数: 60
引用论文

引用论文

Seafood Enzymes
err2012-04-26
err0
PREAI
errM. K. Nielsen; H. H. Nielsen
err分享
err收藏
err分享
err收藏
Mo(Co)6Induced Cleavage of Oximes
err2006-08-22
err0
PREAI
errFlorence Geneste; Nadia Racelma; Alec Moradpour
err分享
err收藏
ALAN: adaptive learning for multi-agent navigation
err2018-02-19
err10
errOAAI
errGodoy, Julio; Chen, Tiannan; Guy, Stephen J.; Karamouzas, Ioannis; Gini, Maria
err分享
err收藏
学者 查看更多内容