arrow
返回

DRL-Based Resource Allocation in Remote State Estimation

delete2023-07-01
delete8
delete
OA
AI
G
Gaoyang Pang
W
Wanchun Liu *
Yonghui Li 封面图
Yonghui Li (Yonghui Li)
B
Branka Vucetic
DOI:10.1109/TWC.2022.3225581delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Remote state estimation where sensors send their measurements of distributed dynamic plants to a remote estimator over shared wireless resources is essential for mission-critical applications of Industry 4.0. Existing algorithms on dynamic radio resource allocation for remote estimation systems assumed oversimplified wireless communications models and can only work for small-scale settings. In this work, we consider remote estimation systems with practical wireless models over the orthogonal multiple-access and non-orthogonal multiple-access schemes. We derive necessary and sufficient conditions under which remote estimation systems can be stabilized. The conditions are described in terms of the transmission power budget, channel statistics, and plants' parameters. For each multiple-access scheme, we formulate a novel dynamic resource allocation problem as a decision-making problem for achieving the minimum overall long-term average estimation mean-square error. Both the estimation quality and the channel quality states are taken into account for decision making. We systematically investigated the problems under different multiple-access schemes with large discrete, hybrid discrete-and-continuous, and continuous action spaces, respectively. We propose novel action-space compression methods and develop advanced deep reinforcement learning algorithms to solve the problems. Numerical results show that our algorithms solve the resource allocation problems effectively and provide much better scalability than the literature.
Keyword:
Remote state estimation
radio resource allocation
non-orthogonal multiple access
deep reinforcement learning
task-oriented communications

期刊

IEEE Transactions on Wireless Communications 封面图
IEEE Transactions on Wireless Communications
IF:
10.7
论文数:
1.3W
被引数:
5.3W

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
引用论文

引用论文

Experimental Investigation on Thermal Performance of a PV/T-PCM (Photovoltaic/Thermal) System Cooling with a PCM and Nanofluid
err2019-07-04
err0
errOAAI
errM. Sarafraz; Mohammad Safaei; Arturo Leon; Iskander Tlili; Tawfeeq Alkanhal; Zhe Tian; Marjan Goodarzi; M. Arjomandi
err分享
err收藏
err分享
err收藏
Biosynthesis of Antibiotics by PGPR and Their Roles in Biocontrol of Plant Diseases
err2019-10-12
err0
PREAI
errAhmed Kenawy; Daniel Joe Dailin; Gaber Attia Abo-Zaid; Roslinda Abd Malek; Kugan Kumar Ambehabati; Khairun Hani Natasya Zakaria; R. Z. Sayyed; Hesham Ali El Enshasy
err分享
err收藏
Foundations of control and estimation over lossy networks
err2007-01-01
err1.1K
errOAAI
errSchenato, Luca; Sinopoli, Bruno; Franceschetti, Massimo; Poolla, Kameshwar; Sastry, S. Shankar
err分享
err收藏
Wireless Network Design for Control Systems: A Survey控制系统的无线网络设计: 综述
err2018-01-01
err314
errOAAI
errPark, Pangun; Ergen, Sinem Coleri; Fischione, Carlo; Lu, Chenyang; Johansson, Karl Henrik
err分享
err收藏
Deep reinforcement learning for wireless sensor scheduling in cyber-physical systems
err2020-03-01
err92
errOAAI
errLeong, Alex S.; Ramaswamy, Arunselvan; Quevedo, Daniel E.; Karl, Holger; Shi, Ling
err分享
err收藏
学者 查看更多内容