.png){kind=icon}
返回
Risk-aware intermediate dataset backup strategy in cloud-based data intensive workflows
.png){kind=icon}
OA
AI
DOI：10.1016/j.future.2014.08.009.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Data-intensive workflows are generally computing- and data-intensive with large volume of data generated during their execution. Therefore, some of the data should be saved to avoid the expensive re-execution of tasks in case of exceptions. However, cloud-based data storage services come at some expense. In this paper, we introduce the risk evaluation model tailored for workflow structure to measure and achieve the trade-off between the overhead of backup storage and the cost of data regeneration in failure, making the service selection and execution more efficient and robust. The proposed method computes and compares the potential loss with and without data backup to achieve the trade-off between overhead of intermediate dataset backup and task re-execution after exceptions. We also design the utility function with the model and apply a genetic algorithm to find the optimized schedule. The results show that the robustness of the schedule is increased while the possible risk of failure is minimized, especially when the volume of generated data is not large in comparison with the input. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Data-intensive workflow
Risk evaluation
Robustness
Intermediate dataset
Checkpoint
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
.png){kind=icon}
Heterogeneities along the 2009 L'Aquila normal fault inferred by the b‐value distribution通过b值分布推断的2009年拉奎拉正断层沿线的异质性OAAI
OAAI分享收藏分享收藏分享收藏
查看更多内容