arrow
Return

Improving Data-Driven Reinforcement Learning in Wireless IoT Systems Using Domain Knowledge

delete2021-11-01
delete0
PRE
AI
N
Nicholas Mastronarde *
N
Nikhilesh Sharma
J
Jacob Chakareski
DOI:10.1109/MCOM.111.2000949delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Reinforcement learning (RL) algorithms are purely data-driven and do not leverage any domain knowledge about the nature of the available actions, the system's state transition dynamics, and its cost/reward function. This severely penalizes their ability to meet critical requirements of emerging wireless applications, due to the inefficiency with which these algorithms learn from their interactions with the environment. In this article, we describe how data-driven RL algorithms can be improved by systematically integrating basic system models into the learning process. Our proposed approach uses real-time data in conjunction with knowledge about the underlying communication system to achieve orders of magnitude improvement in key performance metrics, such as convergence speed and compute/memory complexity, relative to well-established RL benchmarks.
Keywords:
Wireless communication
Measurement
Heuristic algorithms
Computational modeling
Reinforcement learning
Benchmark testing
Real-time systems
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Communications Magazine cover
IEEE Communications Magazine
IF:
8.2
Papers:
6.9K
Citations:
2.2W

Organization

S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65
U
university at buffalo, suny
Scholars:
1.2W
Papers: 9.5K
Citations: 9