arrow
Return

Multisatellite Scheduling via Reinforcement Learning-Based Mixed Integer Linear Programming

delete2026-01-01
delete0
PRE
AI
Q
Qingyu Qu
K
Kexin Liu
J
Jinhu Lü
DOI:10.1109/TAES.2025.3632780delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Agile satellites possess advanced Earth observation capabilities and highly flexible attitude maneuvering, rendering their scheduling problems increasingly crucial. As the number of such satellites continues to grow, mission scheduling has become considerably more complex, with more frequent observation conflicts, tighter resource coupling, and higher computational demands. To address these challenges, this article addresses the agile satellite scheduling problem by formulating a mixed integer linear programming model and solving it using the branch-and-bound (B&B) algorithm. Specifically, we improve the B&B algorithm's efficiency by leveraging reinforcement learning (RL) to optimize variable selection during the branching process. To enhance training robustness, we propose a novel Q-network framework that integrates a superior Q-network as a competitive regularizer. This framework constrains the learned policy to align with demonstration-based behaviors, forming a conservative online RL strategy. Numerical experiments on different scenarios demonstrate that the proposed method efficiently obtains high-quality solutions, outperforming traditional approaches in scheduling performance.
Keywords:
Branch-and-bound (B&B)
mixed integer linear programming (MILP)
multisatellite scheduling
reinforcement learning (RL)

Journal

IEEE Transactions on Aerospace and Electronic Systems cover
IEEE Transactions on Aerospace and Electronic Systems
IF:
5.7
Papers:
827
Citations:
2.4W

Organization

B
beihang university
Scholars:
5.2K
Papers: 2.0K
Citations: 21
Cited Papers

Cited Papers

Mixed-integer programming models for optimal constellation scheduling given cloud cover uncertainty
err2019-06-01
err46
errOAAI
errValicka, Christopher G.; Garcia, Deanna; Staid, Andrea; Watson, Jean-Paul; Hackebeil, Gabriel; Rathinam, Sivakumar; Ntaimo, Lewis
errShare
errSave
errShare
errSave
errShare
errSave
Learning to Branch in Mixed Integer Programming
err2016-02-21
err0
errOAAI
errElias Khalil; Pierre Le Bodic; Le Song; George Nemhauser; Bistra Dilkina
errShare
errSave
researcher View more