arrow
返回

Data Replication in Data Intensive Scientific Applications with Performance Guarantee

delete2011-08-01
delete57
delete
OA
AI
B
Bin Tang
L
Liqiang Wang
S
Shiyong Lu
DOI:10.1109/TPDS.2010.207delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Data replication has been well adopted in data intensive scientific applications to reduce data file transfer time and bandwidth consumption. However, the problem of data replication in Data Grids, an enabling technology for data intensive applications, has proven to be NP-hard and even non approximable, making this problem difficult to solve. Meanwhile, most of the previous research in this field is either theoretical investigation without practical consideration, or heuristics-based with little or no theoretical performance guarantee. In this paper, we propose a data replication algorithm that not only has a provable theoretical performance guarantee, but also can be implemented in a distributed and practical manner. Specifically, we design a polynomial time centralized replication algorithm that reduces the total data file access delay by at least half of that reduced by the optimal replication solution. Based on this centralized algorithm, we also design a distributed caching algorithm, which can be easily adopted in a distributed environment such as Data Grids. Extensive simulations are performed to validate the efficiency of our proposed algorithms. Using our own simulator, we show that our centralized replication algorithm performs comparably to the optimal algorithm and other intuitive heuristics under different network parameters. Using GridSim, a popular distributed Grid simulator, we demonstrate that the distributed caching technique significantly outperforms an existing popular file caching technique in Data Grids, and it is more scalable and adaptive to the dynamic change of file access patterns in Data Grids.
Keyword:
Data intensive applications
Data Grids
data replication
algorithm design and analysis
simulations
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

U
university of wyoming
学者数:
6.4K
论文数: 5.9K
被引数: 8
W
wayne state university
学者数:
2.0W
论文数: 1.6W
被引数: 17
Wichita State University 封面图
Wichita State University
学者数:
1.3K
论文数: 1.1K
被引数: 1.5K
学者 查看更多机构
引用论文

引用论文

Epidemiologie der Myopie
err2016-09-06
err0
PREAI
errS. Hopf; N. Pfeiffer
err分享
err收藏
Nutrient Competition: A New Axis of Tumor Immunosuppression
errCell
IF0
err2015-09-01
err0
errOAAI
errMadhusudhanan Sukumar; Rahul Roychoudhuri; Nicholas P. Restifo
err分享
err收藏
The Globus Replica Location Service: Design and Experience
err2009-09-01
err36
PREAI
errChervenak, Ann L.; Schuler, Robert; Ripeanu, Matei; Amer, Muhammad Ali; Bharathi, Shishir; Foster, Ian; Iamnitchi, Adriana; Kesselman, Carl
err分享
err收藏
err分享
err收藏
err分享
err收藏
Improved MPPT adaptive incremental conductance algorithm
err2014-10-01
err0
PREAI
errArturo Morales-Acevedo; Jose Luis Diaz-Bernabe; Ruben Garrido-Moctezuma
err分享
err收藏
Collinear facilitation and contour integration in autistic adults: Examining lateral and feedback connectivity
err2020-12-01
err0
errOAAI
errEmma Gowen; Stephen Jachim; Sabrina Subri; Christine Dickinson; Benjamin Hamblin-Pyke; Paul A. Warren
err分享
err收藏
Rolling Bearing Fault Diagnosis Using Sample Entropy and 1.5 Dimension Spectrum Based on EMD
err2013-01-01
err0
PREAI
errXian You Zhong; Chun Hua Zhao; Hai Jiang Dong; Xian Ming Liu; Liang Cai Zeng
err分享
err收藏
学者 查看更多内容