.png){kind=icon}
返回
Multi-Agent Federated Q-Learning Algorithms for Wireless Edge Caching
.png){kind=icon}
PRE
AI
DOI：10.1109/TVT.2024.3473738.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Edge caching is an increasingly vital technique in wireless networks, particularly needed to address users' repeated demands, including real-time traffic data and map access in vehicular communications. This paper presents a three-tier system for edge caching, integrating massive multiple-input multiple-output (mMIMO) networks. We consider a scenario with an extensive file library whose size is larger than the aggregated caching capacity of the small base stations (SBSs). Each SBS proactively caches files based on dynamic file popularity that is unknown in advance. A distinguishing aspect of our model is its file-wise approach to the cache instead of the conventional vector-wise methods based on aggregate popularity. This approach introduces additional computational challenges concerning the extensive file library. We formulated the optimization problem to maximize the long-term discounted cache hit rate while minimizing the delivery delay. For the solution, two multi-agent federated Q-learning algorithms are proposed. The first algorithm employs selective updates of the Q-values of popular files to minimize computational overhead. The second algorithm incorporates linear function approximation (LFA) and tensor completion (TC) to streamline the updating process further, reducing the required parameter number. Through the real-world MovieLens dataset and compared with various baseline algorithms, simulations demonstrate that our proposed algorithm can reduce the delay by around 2.60--21.29%, improve the cache hit rate by around 5.71--66.42%, and reduce the computational complexity by at most 97.91%.
Keyword:
Libraries
Tensors
Heuristic algorithms
Delays
Vehicle dynamics
Computational modeling
Vectors
Real-time systems
Matrix decomposition
Communication system security
Large file library
linear function approximation
massive multiple-input multiple-output
tensor completion
wireless edge caching
期刊
IF:
7.1
论文数:
1.8W
被引数:
6.6W
机构
引用论文
Traffic Flow Prediction With Missing Data Imputed by Tensor Completion Methods基于张量补全法的缺失数据交通流预测.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏Collaborative Edge Caching and Transcoding for 360° Video Streaming Based on Deep Reinforcement Learning基于深度强化学习的360 ° 视频流协同边缘缓存与转码
PREAI
分享收藏
分享收藏
查看更多内容