arrow
返回

Soft Actor-Critic-Based Computation Offloading in Multiuser MEC-Enabled IoT-A Lifetime Maximization Perspective

delete2023-10-15
delete6
PRE
AI
A
Ali Reza Heidarpour *
M
Mohammad Reza Heidarpour
M
Masoud Ardakani
C
Chintha Tellambura
M
Murat Uysal
DOI:10.1109/JIOT.2023.3277753delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article studies the network lifetime optimization problem in a multiuser mobile-edge computing (MEC)-enabled Internet of Things (IoT) system comprising an access point (AP), a MEC server, and a set of K mobile devices (MDs) with limited battery capacity. Considering the residual battery energy at the MDs, stochastic task arrivals, and time-varying wireless fading channels, a soft actor-critic (SAC)-based deep reinforcement learning (DRL) lifetime maximization, called DeepLM, is proposed to jointly optimize the task splitting ratio, the local CPU-cycle frequencies at the MDs, the bandwidth allocation, and the CPU-cycle frequency allocation at the MEC server subject to the task queuing backlogs constraint, the bandwidth constraint, and maximum CPU-cycle frequency constraints at the MDs and the MEC server. Our results reveal that DeepLM enjoys a fast convergence rate and a small oscillation amplitude. We also compare the performance of DeepLM with three benchmark offloading schemes, namely, fully edge computing (FEC), fully local computing (FLC), and random computation offloading (RCO). DeepLM increases the network lifetime by 496% and 229% compared to the FLC and RCO schemes. Interestingly, it achieves such a colossal lifetime improvement when its nonbacklog probability is 0.99, while that of FEC, FLC, and RCO is 0.69, 0.53, and 0.25, respectively, showing a significant performance gain of 30%, 46%, and 74%.
Keyword:
Deep reinforcement learning (DRL)
Internet of Things (IoT)
lifetime maximization
mobile-edge computing (MEC)
soft actor-critic (SAC)

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

I
Istanbul University
学者数:
1.2W
论文数: 7.8K
被引数: 6
U
university of alberta
学者数:
5.1W
论文数: 4.9W
被引数: 65
I
Isfahan University of Technology
学者数:
9.0K
论文数: 8.6K
被引数: 8.7K
学者 查看更多机构
引用论文

引用论文

Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling
err2017-01-01
err754
PREAI
errThinh Quang Dinh; Tang, Jianhua; La, Quang Duy; Quek, Tony Q. S.
err分享
err收藏
Energy-Efficient Offloading for Mobile Edge Computing in 5G Heterogeneous Networks5g异构网络中面向移动边缘计算的高能效卸载
err2016-01-01
err654
errOAAI
errZhang, Ke; Mao, Yuming; Leng, Supeng; Zhao, Quanxin; Li, Longjiang; Peng, Xin; Pan, Li; Maharjan, Sabita; Zhang, Yan
err分享
err收藏
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
err2019-06-01
err529
errOAAI
errChen, Xianfu; Zhang, Honggang; Wu, Celimuge; Mao, Shiwen; Ji, Yusheng; Bennis, Mehdi
err分享
err收藏
Substance Use and Mental Health Trends Among U.S. Military Active Duty Personnel: Key Findings From the 2008 DoD Health Behavior Survey
err2010-06-01
err0
errOAAI
errRobert M. Bray; Michael R. Pemberton; Marian E. Lane; Laurel L. Hourani; Mark J. Mattiko; Lorraine A. Babeu
err分享
err收藏
err分享
err收藏
学者 查看更多内容