arrow
Return

A DSM-based fragmented data sharing framework for grids

delete2010-04-01
delete0
PRE
AI
P
Po‐Cheng Chen *
J
Jyh‐Biau Chang
C
Ce-Kuen Shieh
C
Chia-Han Lin
Y
Yi-Chang Zhuang
DOI:10.1016/j.future.2009.12.008delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Sharing scientific and data capture files of gigabyte and terabyte size in conventional data grid systems is inefficient because conventional approaches copy the entire shared file to a user's local storage even when only a tiny file fragment is required. Such transfer schemes consume unnecessary data transmission time and local storage space, with the additional problem of maintaining replica synchronization. Traditionally, replica consistency treats shared files as read-only, consequently sacrificing guaranteed replica consistency. This paper presents a DSM-based fragmented data sharing framework called Spigot which transfers only the necessary fragments of large files on user demand, thereby reducing data transmission time, wasted network bandwidth and required storage space. Data waiting time is further reduced by overlapping data transmission and data analysis. The DSM concept maintains replica synchronization. Real experiments show reduced turnaround time in data-intensive applications, particularly when fragment size is low and analysis time and network latency are high. (C) 2010 Elsevier B.V. All rights reserved.
Keywords:
Data grid
Distributed Shared Memory (DSM)
On-demand access
Data consistency
Teamster-G
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.8K
Citations:
2.3W

Organization

N
National Cheng Kung University
Scholars:
2.6W
Papers: 2.3W
Citations: 1.7W
I
industrial technology research institute - taiwan
Scholars:
2.6K
Papers: 2.7K
Citations: 1