arrow
返回

HDCache: A Distributed Cache System for Real-Time Cloud Services

delete2016-02-06
delete5
PRE
AI
张静 封面图
张静 (Jing Zhang) *
Q
Qianmu Li
周维 封面图
周维 (Wei Zhou)
DOI:10.1007/s10723-015-9360-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Providing a real-time cloud service requires simultaneously retrieving a large amount of data. How to improve the performance of file access becomes a great challenge. This paper first addresses the preconditions of dealing with this problem considering the requirements of applications, hardware, software, and network environments in the cloud. Then, a novel distributed layered cache system named HDCache is proposed. HDCahe is built on the top of Hadoop Distributed File System (HDFS). Applications can integrate the client library of HDCache to access the multiple cache services. The cache services are built up with three access layers an in-memory cache, a snapshot of the local disk, and a network disk provided by HDFS. The files loaded from HDFS are cached in a shared memory which can be directly accessed by the client library. In order to improve robustness and alleviate workload, the cache services are organized in a peer-to-peer style using a distributed hash table and every cached file has three replicas scattered in different cache service nodes. Experimental results show that HDCache can store files with a wide range in their sizes and has the access performance in a millisecond level under highly concurrent environments. The tested hit ratio obtained from a real-world cloud serviced is higher than 95 %.
Keyword:
Distributed cache
Cloud storage
Real-time file access
In-memory system
HDFS

期刊

Journal of Grid Computing 封面图
Journal of Grid Computing
IF:
2.9
论文数:
762
被引数:
1.2K

机构

Y
Yunnan University
学者数:
1.6W
论文数: 9.9K
被引数: 13
引用论文

引用论文

pH Dependence of the Four Individual Transitions in the Catalytic S-Cycle during Photosynthetic Oxygen Evolution
err2002-04-11
err0
PREAI
errGábor Bernát; Fatemeh Morvaridi; Yashar Feyziyev; Stenbjörn Styring
err分享
err收藏
Cloud Platform Datastore Support
err2012-10-14
err8
errOAAI
errChohan, Navraj; Bunch, Chris; Krintz, Chandra; Canumalla, Navyasri
err分享
err收藏
err分享
err收藏
Federation in Cloud Data Management: Challenges and Opportunities云数据管理中的联合: 挑战与机遇
err2014-07-01
err15
errOAAI
errChen, Gang; Jagadish, H. V.; Jiang, Dawei; Maier, David; Ooi, Beng Chin; Tan, Kian-Lee; Tan, Wang-Chiew
err分享
err收藏
Facile preparation of in situ coated Ti3C2Tx/Ni0.5Zn0.5Fe2O4composites and their electromagnetic performance原位涂层Ti3C2Tx/Ni0.5Zn0.5Fe2O4 复合材料及其电磁性能
err2017-01-01
err0
errOAAI
errYoubing Li; Xiaobing Zhou; Jing Wang; Qihuang Deng; Mian Li; Shiyu Du; Young-Hwan Han; Jaehyung Lee; Qing Huang
err分享
err收藏
Developing and Evaluating Intermodal E-Sharing Services–A Multi-method Approach
err2014-01-01
err0
errOAAI
errJörn-Ole Schröder; Christine Weiß; Martin Kagerbauer; Nicolas Reiß; Christian Reuter; Rimbert Schürmann; Steven Pfisterer
err分享
err收藏
学者 查看更多内容