arrow
Return

Q-Learning Based Content Placement Method for Dynamic Cloud Content Delivery Networks

delete2019-01-01
delete16
delete
OA
AI
刘玉杰 (Yujie Liu)
D
Dianjie Lu *
G
Guijuan Zhang
J
Jie Tian
W
Weizhi Xu
DOI:10.1109/ACCESS.2019.2917564delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
How to reduce the content placement cost of cloud content delivery networks (CCDNs) is a hot topic in recent years. Traditional content placement methods mainly reduce the cost of content placement by constructing delivery trees, but they cannot adapt to the dynamic deployment of cloud proxy servers in the CCDNs. In addition, the traditional content placement method only provides delivery paths according to local decision-making without considering global dynamics of the congestion in the CCDNs, which is also one of the main factors causing high cost of content placement. To solve these problems, we propose a content placement model based on Q-learning for the dynamic CCDNs, called Q-content placement model (Q-CPM). This Q-learning approach can lead to better routing decisions due to up-to-date and more reliable congestion values. Then, based on the Q-CPM model, an algorithm is proposed to construct the Q-adaptive delivery tree (Q-ADT). In this algorithm, local and nonlocal congestion information is propagated over network learning packets. Through this algorithm, the paths with low congestion cost will be selected and can adapt to the dynamic cloud delivery environment. The experimental results show that the method can adapt to the dynamic changes of the CCDNs flexibly and reduce the overall congestion cost of content placement effectively.
Keywords:
Content placement
dynamic CCDNs
congestion information
Q-learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

S
shandong normal university
Scholars:
1.0W
Papers: 8.2K
Citations: 3