返回
Multi-stream (Q , r) model and optimization for data prefetching
DOI:10.1016/j.ejor.2021.12.007.png)
摘要
En 中文
Modern high-end computing systems, such as storage servers used in Youtube and Tiktok, serve large numbers of concurrent streams, each of which requires aggressive prefetching. This multi-stream prefetching problem, which strives to serve as many requests as possible from the memory cache and minimize response time, remains as an open challenge in computer science research. To address the efficient resource management for data prefetching, this paper introduces a novel method adopted from inventory management of multiple products in operations research. It proposes a unique constrained multi-stream (Q, r) model which simultaneously determines the prefetching degree (order quantity) Q and trigger distance (reorder point) r for each application stream, taking into account the distinct data request rates of the streams. The model has the objective of minimizing the cache miss level (backorder level), which determines the access latency, as well as constraints on the cache space (inventory space) and the total prefetching frequency (total order frequency). Specifically, the disk access time (lead time) is a function of both the prefetching degree and the total prefetching frequency, the latter of which represents the system load. We present the analytical properties of the model, provide numerical optimization examples, and conduct sensitivity analysis to further demonstrate the insights of this prefetching problem. Significantly, an empirical evaluation proves the effectiveness of the prefetching policy provided by our model. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Inventory
Constrained multi-stream (Q, r ) model
Data prefetching
Optimization
Computing system
期刊
IF:
6
论文数:
2.2W
被引数:
6.4W
机构
引用论文
Reducing emissions in transportation and inventory management: (R, Q) Policy with considerations of carbon reduction减少运输和库存管理中的排放 :( R,Q) 考虑减少碳排放的政策
Improvement of Motility and Fertilization Potential of Postthaw Human Sperm Using Glutamine
Cryobiology
IF0

