Bayesian Reinforcement Learning for Link-Level Throughput Maximization

Hesam Khoshkbari

doi:10.1109/LCOMM.2020.2990308

Bayesian Reinforcement Learning for Link-Level Throughput Maximization

2020-08-01

4

PRE

AI

DOI：10.1109/LCOMM.2020.2990308

原文链接

原文求助

摘要

En 中文

One intrinsic property of neural networks is making confident decisions because they do not capture uncertainty in training data. As a result, when Neural Networks (NN) are used in Deep Reinforcement Learning (DRL), agents cannot explore the action-space effectively. Bayesian Neural Networks (BNN) is one alternative that, instead of one value, assigns a probability distribution to the weights of NN. Using BNN as the policy network of an RL agent, the RL agent will have natural exploration capability. Recent studies demonstrate high potential for the application of RL methods in wireless networks. The inefficient exploration capability, however, limits their use cases. In this letter, we show how Bayesian RL agents can be used to solve complex wireless resource allocation problems. We consider the link-level throughput maximization that needs simultaneous power and Modulation/Coding Scheme (MCS) assignment to each user. We show that due to the large and sparse action-space, only Bayes-by-Backprop Q-network (BBQN) agents can find proper assignments. Simulation results show the performance of the proposed scheme in different network settings.

Keyword:

Throughput

Bayes methods

Artificial neural networks

Uncertainty

Training

Reinforcement learning

Bayesian RL (BRL)

Deep Learning

Link level Throughput

Bayesian Reinforcement Learning for Link-Level Throughput Maximization

摘要

AI总结

期刊

机构

引用论文