.png){kind=icon}
返回
An adaptive DNN inference acceleration framework with end-edge-cloud collaborative computing
.png){kind=icon}
PRE
AI
DOI：10.1016/j.future.2022.10.033.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep Neural Networks (DNNs) based on intelligent applications have been intensively deployed on mobile devices. Unfortunately, resource-constrained mobile devices cannot meet stringent latency requirements due to a large amount of computation required by these intelligent applications. Both exiting cloud-assisted DNN inference approaches and edge-assisted DNN inference approaches can reduce end-to-end inference latency through offloading DNN computations to the cloud server or edge servers, but they suffer from unpredictable communication latency caused by long wide-area massive data transmission or performance degeneration caused by the limited computation resources. In this paper, we propose an adaptive DNN inference acceleration framework, which accelerates DNN inference by fully utilizing the end-edge-cloud collaborative computing. First, a latency prediction model is built to estimate the layer-wise execution latency of a DNN on different heterogeneous computing platforms, which use neural networks to learn non-linear features related to inference latency. Second, a computation partitioning algorithm is designed to identify two optimal partitioning points, which adaptively divide DNN computations into end devices, edge servers, and the cloud server for minimizing DNN inference latency. Finally, we conduct extensive experiments on three widely -adopted DNNs, and the experimental results show that our latency prediction models can improve the prediction accuracy by about 72.31% on average compared with four baseline approaches, and our computation partitioning approach can reduce the end-to-end latency by about 20.81% on average against six baseline approaches under three wireless networks. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Deep neural networks
DNN inference acceleration
End-edge-cloud collaboration
DNN computation partitioning
Latency prediction model
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT基于深度强化学习的工业物联网DNN推理资源管理
PREAI
分享收藏Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing边缘智能: 用边缘计算铺平人工智能的最后一英里.png)
PROCEEDINGS OF THE IEEE
OAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAI分享收藏Intelligent Edge: Leveraging Deep Imitation Learning for Mobile Edge Computation Offloading智能边缘: 利用深度模仿学习实现移动边缘计算卸载
OAAI
OAAI分享收藏Edge-Assisted Distributed DNN Collaborative Computing Approach for Mobile Web Augmented Reality in 5G NetworksIEEE NETWORKOAAI
IEEE NETWORKIF6.3
OAAI分享收藏EcoMobiFog-Design and Dynamic Optimization of a 5G Mobile-Fog-Cloud Multi-Tier Ecosystem for the Real-Time Distributed Execution of Stream ApplicationsIEEE ACCESS
IEEE ACCESSIF3.6
PREAI
分享收藏JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing ServicesOAAI
OAAI分享收藏
查看更多内容