arrow
Return

Deep Reinforcement Learning-Based Multi-Access in Massive Machine-Type Communication

delete2024-01-01
delete0
delete
OA
AI
N
Nasim Ravi *
N
Nuno Lourenço
M
Marília Curado
E
Edmundo Monteiro
DOI:10.1109/ACCESS.2024.3507577delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The diverse applications of Machine-Type Communication (MTC) lead to exponential growth in Machine to Machine traffic. In connection with MTC deployment, a large number of devices are expected to access the wireless network simultaneously, resulting in network congestion. The conventional Random Access mechanism lacks the capability to handle the large number of access attempts expected from massive MTC (mMTC). Additionally, mMTC transceivers often operate by generating short data packets in a sporadic and sometimes unpredictable manner. To address the growing need for efficient communication in massive machine-type communication scenarios we propose an innovative solution, called Deep Reinforcement Learning-Based Multi-Access (DRLMA). Our model considers the Base Station (BS) as an agent navigating the landscape of machine-type communication devices. This agent dynamically switches between grant-based and grant-free access to leverage their strengths. We address the multi-access problem, formulating it as a Partially Observable Markov Decision Process (POMDP), to better understand and tackle challenges associated with dynamic access policies. Leveraging Deep Reinforcement Learning techniques, our approach optimizes sporadic traffic patterns, crafting an adaptable access policy to maximize both network throughput and energy efficiency under the battery constraint. Simulation results show that proposed DRLMA scheme outperforms traditional access schemes and existing access protocols in sporadic traffic in terms of the energy efficiency, throughput and network life time.
Keywords:
Throughput
Base stations
Ultra reliable low latency communication
Switches
Resource management
Energy efficiency
Batteries
Uplink
NOMA
Interference cancellation
Massive machine-type communication
multiple access
deep reinforcement learning
grant-based
grant-free
sporadic traffic

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
universidade de coimbra
Scholars:
1.9W
Papers: 1.6W
Citations: 16