.png){kind=icon}
返回
Dynamic Split Computing Framework in Distributed Serverless Edge Clouds
.png){kind=icon}
PRE
AI
DOI：10.1109/JIOT.2023.3342438.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Distributed serverless edge clouds and split computing are promising technologies to reduce the inference latency of large-scale deep neural networks (DNNs). In this article, we propose a dynamic split computing framework (DSCF) in distributed serverless edge clouds. In DSCF, the edge cloud orchestrator dynamically determines 1) splitting point and 2) warm status maintenance of container instances (i.e., whether or not to maintain each container instance in a warm status). For optimal decisions, we formulate a constrained Markov decision process (CMDP) problem to minimize the inference latency while maintaining the average resource consumption of distributed edge clouds below a certain level. The optimal stochastic policy can be obtained by converting the CMDP model into a linear programming (LP) model. The evaluation results demonstrate that DSCF can achieve less than half the inference latency compared to the local computing scheme while maintaining sufficient low resource consumption of distributed edge clouds.
Keyword:
Distributed serverless edge cloud
joint optimization
split computing
warm start
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
.png){kind=icon}
Joint Multiuser DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligence面向协作边缘智能的联合多用户DNN划分和计算资源分配
OAAI
OAAI分享收藏When Serverless Computing Meets Edge Computing: Architecture, Challenges, and Open Issues当无服务器计算遇到边缘计算时: 架构、挑战和开放问题
PREAI
分享收藏JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing ServicesOAAI
OAAI分享收藏
查看更多内容