arrow
返回

Intelligent edge content caching: A deep recurrent reinforcement learning method

delete2022-09-06
delete3
PRE
AI
H
Haitao Xu
Y
Yuejun Sun *
郭建博 封面图
郭建博 (Jianbo Guo)
DOI:10.1007/s12083-022-01369-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the rise of 5G network and the rapid growth of user equipment, there exists a gap between the stringent requirements of emerging applications and the actual functionality of the Internet. In particular, transmitting data over long network links imposes high costs, which can be addressed by the edge caching (EC) method. EC caches the content at the edge server to avoid the extraordinary cost of backhaul link communication. However, in existing EC efforts, it is common to assume either known content popularity or a two-phase caching that is predicted content popularity prior to the caching action, the former being less feasible and the latter increasing the cost of deployment to the real world. A caching strategy is proposed in this paper to cope with this problem that can be feasible end-to-end deployed and has a lower caching cost. Specifically, we first investigate the system cost, including network communication cost, cache over storage cost, and cache replacement cost. And we model the EC problem as a Markov Decision Process (MDP). Then, the Double Deep Recurrent Q Network (DDRQN) algorithm is studied to solve the EC-based MDP problem. Finally, compared with other intelligent caching strategies, the proposed caching strategy can improve the system reward by up to 24% and the cache hit rate by up to 22% under certain conditions.
Keyword:
Edge computing
Edge caching
Edge intelligence
Deep recurrent reinforcement learning

期刊

Peer-to-Peer Networking and Applications 封面图
Peer-to-Peer Networking and Applications
IF:
2.6
论文数:
2.2K
被引数:
2.9K

机构

H
Hangzhou Dianzi University
学者数:
1.3W
论文数: 9.6K
被引数: 7.5K
引用论文

引用论文

Complexes of aminophosphonates. Part 8. Copper(II) complexes of N-(phosphonomethyl)amino acids and related compounds
err1994-01-01
err0
PREAI
errMalgorzata Jezowska-Bojczuk; Tamas Kiss; Henryk Kozłowski; Patrick Decock; Jozef Barycki
err分享
err收藏
A Survey of Multi-Access Edge Computing in 5G and Beyond: Fundamentals, Technology Integration, and State-of-the-Art
err2020-01-01
err490
errOAAI
errQuoc-Viet Pham; Fang, Fang; Vu Nguyen Ha; Piran, Md Jalil; Le, Mai; Le, Long Bao; Hwang, Won-Joo; Ding, Zhiguo
err分享
err收藏
Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks
err2020-01-01
err248
PREAI
errQiao, Guanhua; Leng, Supeng; Maharjan, Sabita; Zhang, Yan; Ansari, Nirwan
err分享
err收藏
err分享
err收藏
学者 查看更多内容