.png){kind=icon}
返回
DeepChunk: Deep Q-Learning for Chunk-Based Caching in Wireless Data Processing Networks
.png){kind=icon}
OA
AI
DOI：10.1109/TCCN.2019.2947550.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A Data Processing Network (DPN) streams massive volumes of data collected and stored by the network to multiple processing units to compute desired results in a timely fashion. Due to ever-increasing traffic, distributed cache nodes can be deployed to store hot data and rapidly deliver them for consumption. However, prior work on caching policies has primarily focused on the potential gains in network performance, e.g., cache hit ratio and download latency, while neglecting the impact of cache on data processing and consumption. In this paper, we propose a novel framework, DeepChunk, which leverages deep Q-learning for chunk-based caching in wireless DPN. We show that cache policies must be optimized for both network performance during data delivery and processing efficiency during data consumption. Specifically, DeepChunk utilizes a model-free approach by jointly learning limited network, data streaming, and processing statistics at runtime and making cache update decisions under the guidance of deep Q-learning. It enables a joint optimization of multiple objectives including chunk hit ratio, processing stall time, and object download time while being self-adaptive under the time-varying workload and network conditions. We build a prototype implementation of DeepChunk with Ceph, a popular distributed object storage system. Based on real-world Wifi and 4G traces, our extensive experiments and evaluation demonstrate significant improvement, i.e., 52% increase in total reward and 68% decrease in processing stall time, over a number of baseline caching policies.
Keyword:
Data streaming and processing
caching
reinforcement learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
7
论文数:
1.5K
被引数:
5.5K
机构
引用论文
.png){kind=icon}
分享收藏The compartmentalization of the monkey and rat cerebellar cortex: zebrin I and cytochrome oxidase
PREAI
分享收藏Sprout: A Functional Caching Approach to Minimize Service Latency in Erasure-Coded StorageSprout: 一种功能缓存方法，可最大程度地减少擦除编码存储中的服务延迟OAAI
OAAI分享收藏分享收藏Cyclisches Bis(phosphanyl)carbenium‐Ion durch Protonierung eines 1,3‐Diphosphacyclobutan‐2,4‐diyls环化双 (膦酰基) 碳烯离子durch Protonierung eines 1,3-二磷酸环丁烷-2,4
PREAI
分享收藏
查看更多内容