arrow
返回

Reinforcement Learning Based Energy-Efficient Collaborative Inference for Mobile Edge Computing

delete2023-02-01
delete26
PRE
AI
Y
Yilin Xiao
肖亮 封面图
肖亮 (Liang Xiao)
K
Kunpeng Wan
H
Helin Yang
Y
Yi Zhang *
Y
Yi Wu
Y
Yanyong Zhang
DOI:10.1109/TCOMM.2022.3229033delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Collaborative inference in mobile edge computing (MEC) enables mobile devices to offload the computation tasks for the computation-intensive perception services, and the inference policy determines the inference latency and energy consumption. The optimal inference policy depends on the inference performance model of deep learning, the data generation model and the network model that are rarely known by mobile devices in time. In this paper, we propose a multi-agent reinforcement learning (RL) based energy-efficient MEC collaborative inference scheme, which enables each mobile device to choose both the partition point of deep learning and the collaborative edge of each mobile device based on the image quantity, the channel conditions and the previous inference performance. A learning experience exchange mechanism exploits the Q-values of the neighboring mobile devices to accelerate the inference policy optimization with less energy consumption. We also provide a deep multi-agent RL based inference scheme to accelerate learning for large-scale MEC networks, in which an actor network yields the collaborative inference policy probability distribution and a critic network guides the weight update of the actor network to enhance sample efficiency. We provide the inference performance bound and analyze the computational complexity. Both simulation and experimental results show that our proposed schemes reduce the inference latency and save the MEC energy consumption.
Keyword:
Mobile handsets
Collaboration
Servers
Energy consumption
Performance evaluation
Deep learning
Computational modeling
Collaborative inference
computation partition
mobile edge computing
multi-agent reinforcement learning

期刊

IEEE Transactions on Communications 封面图
IEEE Transactions on Communications
IF:
8.3
论文数:
1.2W
被引数:
3.6W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
X
xiamen university
学者数:
5.9W
论文数: 3.8W
被引数: 67
引用论文

引用论文

Performance Study of Screen-Printed Textile Antennas after Repeated Washing丝网印刷纺织品天线反复洗涤后的性能研究
err2014-06-17
err0
errOAAI
errI. Kazani; F. Declercq; M. L. Scarpello; C. Hertleer; H. Rogier; D. Vande Ginste; G. De Mey; G. Guxho; L. Van Langenhove
err分享
err收藏
HiveMind: Towards Cellular Native Machine Learning Model Splitting
err2022-02-01
err38
PREAI
errWang, Song; Zhang, Xinyu; Uchiyama, Hiromasa; Matsuda, Hiroki
err分享
err收藏
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey边缘计算和深度学习的融合: 综合综述
err2020-01-01
err812
errOAAI
errWang, Xiaofei; Han, Yiwen; Leung, Victor C. M.; Niyato, Dusit; Yan, Xueqiang; Chen, Xu
err分享
err收藏
Edge-Assisted Distributed DNN Collaborative Computing Approach for Mobile Web Augmented Reality in 5G Networks
err2020-03-01
err44
errOAAI
errRen, Pei; Qiao, Xiuquan; Huang, Yakun; Liu, Ling; Dustdar, Schahram; Chen, Junliang
err分享
err收藏
学者 查看更多内容