.png){kind=icon}
Return
An adaptive DNN inference acceleration framework with end-edge-cloud collaborative computing
.png){kind=icon}
PRE
AI
DOI：10.1016/j.future.2022.10.033.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Deep Neural Networks (DNNs) based on intelligent applications have been intensively deployed on mobile devices. Unfortunately, resource-constrained mobile devices cannot meet stringent latency requirements due to a large amount of computation required by these intelligent applications. Both exiting cloud-assisted DNN inference approaches and edge-assisted DNN inference approaches can reduce end-to-end inference latency through offloading DNN computations to the cloud server or edge servers, but they suffer from unpredictable communication latency caused by long wide-area massive data transmission or performance degeneration caused by the limited computation resources. In this paper, we propose an adaptive DNN inference acceleration framework, which accelerates DNN inference by fully utilizing the end-edge-cloud collaborative computing. First, a latency prediction model is built to estimate the layer-wise execution latency of a DNN on different heterogeneous computing platforms, which use neural networks to learn non-linear features related to inference latency. Second, a computation partitioning algorithm is designed to identify two optimal partitioning points, which adaptively divide DNN computations into end devices, edge servers, and the cloud server for minimizing DNN inference latency. Finally, we conduct extensive experiments on three widely -adopted DNNs, and the experimental results show that our latency prediction models can improve the prediction accuracy by about 72.31% on average compared with four baseline approaches, and our computation partitioning approach can reduce the end-to-end latency by about 20.81% on average against six baseline approaches under three wireless networks. (c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Deep neural networks
DNN inference acceleration
End-edge-cloud collaboration
DNN computation partitioning
Latency prediction model
Journal
F
IF:
6.1
Papers:
6.9K
Citations:
2.3W
Organization
View more organizations
Cited Papers
ShareSaveEdge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing.png)
PROCEEDINGS OF THE IEEE
OAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAIShareSave
ShareSaveEdge-Assisted Distributed DNN Collaborative Computing Approach for Mobile Web Augmented Reality in 5G NetworksIEEE NETWORKOAAI
IEEE NETWORKIF6.3
OAAIShareSaveShareSaveEcoMobiFog-Design and Dynamic Optimization of a 5G Mobile-Fog-Cloud Multi-Tier Ecosystem for the Real-Time Distributed Execution of Stream ApplicationsIEEE ACCESS
IEEE ACCESSIF3.6
PREAI
ShareSaveJointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing ServicesOAAI
OAAIShareSave View more