arrow
Return

Dynamic Energy Efficient Resource Allocation for Massive MIMO Networks Using Randomized Ensembled Double Q-Learning Algorithm

delete2025-08-01
delete0
PRE
AI
Z
Zhikai Liu
N
Navneet Garg
T
Tharmalingam Ratnarajah
DOI:10.1109/TCCN.2024.3524640delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper tackles the challenge of power consumption in the massive multiple-input multiple-output (mMIMO) base station (BS), where continuous operation of all antennas generates significant heat within a limited physical area. We propose a strategic power control scheme to enhance energy efficiency and mitigate thermal impact. Our approach introduces a time-slotted model incorporating dynamic, time-varying user quality of service (QoS) requirements. We examine energy efficiency under various conditions, presenting discrete and analog power allocation methods for both hybrid and fully digital precoding, with consideration of hardware impairments (HWI). We frame the energy efficiency optimization as dynamic Markov decision process (MDP) problems, constrained by total power, per-antenna power, and dynamic QoS requirements. The randomized ensembled double Q-learning (REDQ) algorithm is utilized with an action coding scheme to reduce computational complexity. By comparing existing reinforcement learning algorithms and evaluating our proposed power allocation schemes across diverse scenarios, simulations demonstrate that our approach improves energy efficiency effectively under varying operational conditions, showcasing its potential as a robust solution for adaptive resource allocation in mMIMO systems.
Keywords:
Dynamic power allocation
energy efficiency
fully digital precoding
hybrid precoding
hardware impairment
reinforcement learning

Journal

I
IEEE Transactions on Cognitive Communications and Networking
IF:
7
Papers:
1.5K
Citations:
5.5K

Organization

T
The University of Edinburgh
Scholars:
771
Papers: 357
Citations: 0