arrow
Return

Log-Regularized Dictionary-Learning-Based Reinforcement Learning Algorithm for GNSS Positioning Correction

delete2024-04-15
delete1
PRE
AI
J
Jianhao Tang
X
Xueni Chen
Z
Zhenni Li *
赵昊立 cover
赵昊立 (Zhao, Haoli)
S
Shengli Xie
K
Kan Xie
V
Victor Kuzin
李波 cover
李波 (Bo Li)
DOI:10.1109/JIOT.2023.3345943delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In dynamic and complex environments, the positioning accuracy of global navigation satellite system (GNSS) will be seriously reduced. Deep reinforcement learning (DRL) has been found to give effective dynamic policy learning for complex GNSS positioning correction tasks. However, catastrophic interference in DRL models caused by the high correlation between successive positioning states, together with instability in gradient backpropagation in deep neural networks (DNNs), produces inaccurate DRL value approximation thereby degrades GNSS positioning performance. In this article, we develop a dictionary learning-based reinforcement learning (RL) algorithm with the nonconvex log regularizer for GNSS positioning correction. To avoid DNN instability problems, a dictionary learning-structured RL model is proposed. It has a feed-forward learning architecture obviating the need for gradient backpropagation. The nonconvex log regularizer for dictionary learning reduces the correlation between states and thereby alleviates interference in RL. This provides sparse representations, which can more effectively capture features and produce representations with lower biases than convex regularizers. Furthermore, the nonconvex optimization is made efficient through a decomposition scheme that generates an explicit closed-form solution using the proximal operator. Finally, based on the proposed dictionary learning-structured RL model, a novel positioning correction method is developed to enhance GNSS positioning accuracy. The experimental results indicate that the proposed method outperforms state-of-the-art sparse coding-based RL methods in benchmark environments. Moreover, the proposed method effectively improves GNSS positioning accuracy relative to the glsms Kalman filter acrlong KF method and the glsms weighted least squares acrlong WLS method.
Keywords:
Catastrophic interference
dictionary learning
global navigation satellite system (GNSS) postitioning
log regularizer
reinforcement learning (RL)

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

M
ministry of education - china
Scholars:
2.5W
Papers: 1.0W
Citations: 13
G
guangdong university of technology
Scholars:
2.9W
Papers: 2.0W
Citations: 36