arrow
Return

A Multimodel Edge Computing Offloading Framework for Deep-Learning Application Based on Bayesian Optimization

delete2023-10-15
delete6
PRE
AI
Z
Zidi Zhao
H
Hong Zhang *
L
Liqiang Wang
H
Huang Hai-jun
DOI:10.1109/JIOT.2023.3280162delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the rapid development of the Internet of Things (IoT), data generated by IoT devices are also increasing exponentially. The edge computing has alleviated the problems of limited network and transmission delay when processing tasks of IoT devices in traditional cloud computing. And with the popularity of deep-learning, more and more terminal devices are embedded with artificial intelligence (AI) processors for higher processing capability at the edge. However, the problems of deep-learning task offloading in a heterogeneous edge computing environment have not been fully investigated. In this article, a multimodel edge computing offloading framework is proposed, using NVIDIA Jetson edge devices (Jetson TX2, Jetson Xavier NX, and Jetson Nano) and GeForce RTX GPU servers (RTX3080 and RTX2080) to simulate the edge computing environment, and make binary computational offloading decisions for face detection tasks. We also introduce a Bayesian optimization algorithm, namely, modified tree-structured Parzen estimator (MTPE), to reduce the total cost of edge computation within a time slot including response time and energy consumption, and ensure the accuracy requirements of face detection. In addition, we employ the Lyapunov model to obtain the harvesting energy between time slots to keep the energy queue stable. Experiments reveal that MTPE algorithm can achieve the globally optimal solution in fewer iterations. The total cost of multimodel edge computing framework is reduced by an average of 17.94% compared to a single-model framework. In contrast to the double deep Q-network (DDQN), our proposed algorithm can decrease the computational consumption by 23.01% for obtaining the offloading decision.
Keywords:
Bayesian optimization
deep-learning
edge computing
Lyapunov drift function
modified tree-structured Parzen estimator (MTPE)
multimodel

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

H
Hebei University
Scholars:
1.5W
Papers: 7.8K
Citations: 1.0W
State University System of Florida cover
State University System of Florida
Scholars:
12.8W
Papers: 10.9W
Citations: 130
Cited Papers

Cited Papers

Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
err2020-01-01
err812
errOAAI
errWang, Xiaofei; Han, Yiwen; Leung, Victor C. M.; Niyato, Dusit; Yan, Xueqiang; Chen, Xu
errShare
errSave
Flexible architecture for deployment of edge computing applications
err2022-01-01
err5
PREAI
errKhakimov, Abdukodir; Elgendy, Ibrahim A.; Muthanna, Ammar; Mokrov, Evgeny; Samouylov, Konstantin; Maleh, Yassine; El-Latif, Ahmed A. Abd
errShare
errSave
Methods of Resource Scheduling Based on Optimized Fuzzy Clustering in Fog Computing
errSENSORS
IF3.5
err2019-05-08
err61
errOAAI
errLi, Guangshun; Liu, Yuncui; Wu, Junhua; Lin, Dandan; Zhao, Shuaishuai
errShare
errSave
Requirement for Croquemort in Phagocytosis of Apoptotic Cells in Drosophila
err1999-06-18
err0
PREAI
errNathalie C. Franc; Pascal Heitzler; R. Alan B.; Ezekowitz; Kristin White
errShare
errSave
A survey on computation offloading modeling for edge computing
err2020-11-01
err196
PREAI
errLin, Hai; Zeadally, Sherali; Chen, Zhihong; Labiod, Houda; Wang, Lusheng
errShare
errSave
Altered expression of leucocyte sialoglycoprotein in Wiskott-Aldrich syndrome is associated with a specific defect in O-glycosylation
err1989-09-01
err0
PREAI
errWenda L. Greer; Elizabeth Higgins; D. Robert Sutherland; Abraham Novogrodsky; Inka Brockhausen; Monica Peacocke; Laurence A. Rubin; Michael Baker; James W. Dennis; Katherine A. Siminovitch
errShare
errSave
researcher View more