.png){kind=icon}
返回
Autonomous Small Body Science Operations Using Reinforcement Learning
.png){kind=icon}
PRE
AI
DOI：10.2514/1.I011376.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This work studies the feasibility of using reinforcement learning for small body science operations subject to resource constraints. Two mission scenarios are considered. In the first scenario, a spacecraft autonomously maneuvers between waypoints about a small body while performing science activities, such as mapping and imaging, and periodically downlinking data and managing on-board resources like battery charge, data buffer storage, and fuel usage. In the second scenario, the spacecraft periodically performs navigation updates to improve its state estimate, ensuring that the collected science is within the specified requirements. A Markov decision process formulation of the mission scenarios is formulated, and reinforcement learning is applied to solve the problem. A range of noisy observation types are tested, demonstrating that a fully observable formulation of the problem trained on direct observations of the state is robust to noisy measurements or a filtered state estimate. A decision-making agent is then trained to manage the state estimate by choosing when to take measurements, demonstrating that near-equivalent policies, in comparison to nominal problem formulation, can be trained with an optional navigation update. Finally, a demonstration is performed in which a ground station outage is simulated. The decision-making agent is shown to be robust to this outage, rapidly adjusting its plan to continue nominal operations.
Keyword:
Reinforcement Learning
Markov Decision Process
Computer Storage Devices
Satellite Broadcasting
Asteroids
Unscented Kalman Filter
Optimal Control Theory
Deep Space Network
Planets
Guidance, Navigation, and Control Systems
期刊
IF:
1.5
论文数:
71
被引数:
987
机构
引用论文
.png){kind=icon}
分享收藏
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Optimization-based scheduling for the single-satellite, multi-ground station communication problem基于优化的单卫星多地面站通信调度问题
PREAI
分享收藏
查看更多内容