返回
Cross-domain data-driven reinforcement learning for IGSO satellite coverage optimization
DOI:10.1016/j.neucom.2024.129278.png)
摘要
En 中文
The beam coverage area of Inclined GeoSynchronous Orbit (IGSO) satellites suffers from a diurnal north-south shift caused by the orbital inclination. Thus, it is crucial to adjust the satellite's attitude for stabilizing the beam coverage area and enhancing the communication signal quality. However, traditional optimization methods fail to optimize attitude due to the intricate orbital environment and the time-consuming simulation solving process. In this paper, we propose a Cross-Domain Data-Driven Reinforcement Learning (C3DRL) algorithm for IGSO satellite coverage optimization, which utilizes offline expert data to assist agent learning and exploration during interactions within the online environment. To overcome the dynamic differences between online and offline environments, a practical cross-domain adaptation approach is proposed. This approach distinguishes dynamics changes and penalizes agents for learning transitions with significant dynamics differences. By addressing the issue of action value function overestimation, we effectively utilize offline data to drive agent learning process. The experimental results show that C3DRL effectively stabilizes the coverage area compared with other algorithms. In addition, several ablation experiments are conducted to demonstrate the effectiveness of the cross-domain adaptation method.
Keyword:
Reinforcement learning
IGSO satellite
Cross domain adaptation
Beam coverage optimization
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Identification and optimal control of nonlinear systems using recurrent neural networks and reinforcement learning: An overview
NEUROCOMPUTING
IF6.5
The fine structure and mechanism of breakdown of larval intersegmental muscles in the blowfly Calliphora erythrocephala蝇Calliphora erythrocephala幼虫节间肌的精细结构和分解机理
A constrastive semi-supervised deep learning framework for land cover classification of satellite time series with limited labels
NEUROCOMPUTING
IF6.5

