arrow
返回

Flimm: Foreground traffic aware data migration manager for distributed storage system

delete2024-11-01
delete0
PRE
AI
B
Bowen Li *
X
Xiaoshe Dong
J
Jue Mi
Y
Yufei Wang
L
Longxiang Wang
W
Weiduo Chen
DOI:10.1016/j.future.2024.05.052delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Currently, decentralized distributed storage system is widely used in various scenarios, because decentralized data placement algorithms observably improve scalability and robustness of distributed storage system. However, storage system applied with decentralized data placement algorithm suffers from uncontrollable data migration during expanding the clusters, which lead to dramatic fluctuation of performance. To maintain reliability and stability of storage system, administrators are under great pressure to migrate data during expansion or contraction. Not only the urgent time constraints to expansion but also low interference to foreground application are required during data migration period. It is a difficult challenge for in-experienced administrators to tackle. To address this challenge, this paper introduces Flimm, a fast and low-interference data migration manager that is aware of storage resource utilization and performs data migration with low interference to foreground applications. Flimm mitigates interference by scheduling a subset of migration tasks with careful consideration. Moreover, Flimm adapts to varying foreground application workloads through adaptive migration speed control, providing administrators with convenient and secure parameters for tuning. In our experiments, Flimm demonstrated a 1.2x acceleration in migration speed and achieved a 20% reduction in interference.
Keyword:
Distributed storage system
Data migration
Schedule algorithm
Interference model
Portable system

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.9K
被引数:
2.3W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
S
State Grid Corporation of China
学者数:
6.5K
论文数: 5.2K
被引数: 1.7K
引用论文

引用论文

Developing and Evaluating Intermodal E-Sharing Services–A Multi-method Approach
err2014-01-01
err0
errOAAI
errJörn-Ole Schröder; Christine Weiß; Martin Kagerbauer; Nicolas Reiß; Christian Reuter; Rimbert Schürmann; Steven Pfisterer
err分享
err收藏
Enabling Routing Control in a DHT在DHT中启用路由控制
err2010-01-01
err43
PREAI
errZhang, Yiming; Chen, Lei; Lu, Xicheng; Li, Dongsheng
err分享
err收藏
Tapestry: A resilient global-scale overlay for service deployment
err2004-01-01
err964
errOAAI
errZhao, BY; Huang, L; Stribling, J; Rhea, SC; Joseph, AD; Kubiatowicz, JD
err分享
err收藏
Synthesis and biological evaluation of N-(7-indolyl)-3-pyridinesulfonamide derivatives as potent antitumor agents
err2002-08-01
err0
PREAI
errTakashi Owa; Hiroshi Yoshino; Tatsuo Okauchi; Tadashi Okabe; Yoichi Ozawa; Naoko Hata Sugi; Kentaro Yoshimatsu; Takeshi Nagasu; Nozomu Koyanagi; Kyosuke Kitoh
err分享
err收藏
没有更多内容