返回
Soft Actor-Critic-Based Computation Offloading in Multiuser MEC-Enabled IoT-A Lifetime Maximization Perspective
DOI:10.1109/JIOT.2023.3277753.png)
摘要
En 中文
This article studies the network lifetime optimization problem in a multiuser mobile-edge computing (MEC)-enabled Internet of Things (IoT) system comprising an access point (AP), a MEC server, and a set of K mobile devices (MDs) with limited battery capacity. Considering the residual battery energy at the MDs, stochastic task arrivals, and time-varying wireless fading channels, a soft actor-critic (SAC)-based deep reinforcement learning (DRL) lifetime maximization, called DeepLM, is proposed to jointly optimize the task splitting ratio, the local CPU-cycle frequencies at the MDs, the bandwidth allocation, and the CPU-cycle frequency allocation at the MEC server subject to the task queuing backlogs constraint, the bandwidth constraint, and maximum CPU-cycle frequency constraints at the MDs and the MEC server. Our results reveal that DeepLM enjoys a fast convergence rate and a small oscillation amplitude. We also compare the performance of DeepLM with three benchmark offloading schemes, namely, fully edge computing (FEC), fully local computing (FLC), and random computation offloading (RCO). DeepLM increases the network lifetime by 496% and 229% compared to the FLC and RCO schemes. Interestingly, it achieves such a colossal lifetime improvement when its nonbacklog probability is 0.99, while that of FEC, FLC, and RCO is 0.69, 0.53, and 0.25, respectively, showing a significant performance gain of 30%, 46%, and 74%.
Keyword:
Deep reinforcement learning (DRL)
Internet of Things (IoT)
lifetime maximization
mobile-edge computing (MEC)
soft actor-critic (SAC)
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Energy-Efficient Offloading for Mobile Edge Computing in 5G Heterogeneous Networks5g异构网络中面向移动边缘计算的高能效卸载
IEEE ACCESS
IF3.6
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
Efficient Resource Allocation for Mobile-Edge Computing Networks With NOMA: Completion Time and Energy Minimization具有NOMA的移动边缘计算网络的有效资源分配: 完成时间和能量最小化
Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks用于无线供电的移动边缘计算网络中在线计算卸载的深度强化学习
Lyapunov-Guided Delay-Aware Energy Efficient Offloading in IIoT-MEC SystemsIiot-mec系统中Lyapunov引导的延迟感知节能卸载

