返回
Q-Learning-Based Task Offloading and Resources Optimization for a Collaborative Computing System
DOI:10.1109/ACCESS.2020.3015993.png)
摘要
En 中文
Mobile edge computing (MEC) can effectively overcome the shortcomings of high-latency in mobile cloud computing (MCC) by deploying the cloud resources, e.g., storage and computational capability, to the edge. However, the limited computation capability of the MEC restricts the scalability of offloading. Therefore, the basic requirements of the MEC system are to explore effective offloading decisions and resource allocation methods. To address it, we develop a collaborative computing system composed of local computing (mobile device), MEC (edge cloud) and MCC (central cloud). Based on the proposed collaborative computing system, we design a novel Q-learning based computation offloading (QLCOF) policy to achieve the optimal resource allocation and offloading scheme by prescheduling the computation side for each task from a global perspective. Specifically, we first model the offloading decision process as a Markov decision process (MDP) and design a state loss function (STLF) to measure the quality of experience (QoE). After that, we define the cumulation of STLFs as the system loss function (SYLF) and formulate an SYLF minimization problem. Due to the difficulty to directly solve the formulated problem, we decompose it into multiple subproblems and preferentially optimize the transmission power and computation frequency of the edge cloud by the quasi-convex bisection and polynomial analysis method, respectively. Based on the precalculated offline transmission power and edge cloud computation frequency, we develop a Q-learning based offloading (QLOF) scheme to minimize the SYLF by optimizing offloading decisions. Finally, the numeral results show that the proposed QLOF scheme effectively reduces the SYLF under different parameters.
Keyword:
Cloud computing
Task analysis
Collaboration
Mobile handsets
Computational modeling
Resource management
Loss measurement
Mobile edge computing (MEC)
mobile cloud computing (MCC)
offloading
resources allocation
MDP
Q-learning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Delay-Constrained Hybrid Computation Offloading With Cloud and Fog Computing云雾计算的时延约束混合计算卸载
IEEE ACCESS
IF3.6
Mobile Edge Computing With Wireless Backhaul: Joint Task Offloading and Resource Allocation基于无线回传的移动边缘计算: 联合任务卸载和资源分配
IEEE ACCESS
IF3.6

