返回
Deep Reinforcement Learning-Based Server Selection for Mobile Edge Computing
DOI:10.1109/TVT.2021.3124127.png)
摘要
En 中文
With Mobile Edge Computing (MEC), computational intensive applications can be offloaded to the nearby edge servers to support latency-sensitive applications on mobile devices. Different from the cloud, edge servers usually have limited resources, and then selecting which edge server to run the offloaded computation becomes an important issue. Although server selection has received considerable attention, not much work has been done to consider the limited coverage of the edge server and the frequent user movement, which introduce many dynamic changing factors affecting the workload of the edge server and making it hard to achieve long-term optimum in the edge server selection. To deal with these challenges, we model the problem of continuous server selection as a Markov Decision Process (MDP). The difficulty of this problem is that achieving long-term optimum requires future knowledge, such as user mobility, server workload, etc, which is not known a priori. We do not have such knowledge and thus cannot find the optimal policy through traditional methods. To address this problem, we propose a Deep Reinforcement Learning (DRL) based algorithm to learn the selection policy based on the observed performance of past server selections. Specifically, a Long Short-Term Memory (LSTM) based neural network is exploited to encode the historical information which helps infer future knowledge of the dynamically changing factors. Then the DRL model selects the optimal server automatically based on the extracted system states. Extensive trace-driven evaluations demonstrate that the proposed DRL-based algorithm has the lowest overall cost compared to existing solutions.
Keyword:
Servers
Costs
Computational modeling
Switches
Delays
Reinforcement learning
Vehicle dynamics
Mobile edge computing
edge server
user mobility
deep reinforcement learning
期刊
IF:
7.1
论文数:
1.8W
被引数:
6.6W
机构
引用论文
CE-IoT: Cost-Effective Cloud-Edge Resource Provisioning for Heterogeneous IoT ApplicationsCe-iot: 为异构IoT应用程序提供经济高效的云边缘资源配置
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
Efficacy and safety of etoricoxib 30 mg and celecoxib 200 mg in the treatment of osteoarthritis in two identically designed, randomized, placebo-controlled, non-inferiority studies
Rheumatology
IF0
Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks用于无线供电的移动边缘计算网络中在线计算卸载的深度强化学习

