arrow
返回

Experience with using the Parallel Workloads Archive

delete2014-10-01
delete192
delete
OA
AI
D
Dror G. Feitelson *
D
Dan Tsafrir
D
David Krakov
DOI:10.1016/j.jpdc.2014.06.013delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Science is based upon observation. The scientific study of complex computer systems should therefore be based on observation of how they are used in practice, as opposed to how they are assumed to be used or how they were designed to be used. In particular, detailed workload logs from real computer systems are invaluable for research on performance evaluation and for designing new systems. Regrettably, workload data may suffer from quality issues that might distort the study results, just as scientific observations in other fields may suffer from measurement errors. The cumulative experience with the Parallel Workloads Archive, a repository of job-level usage data from large-scale parallel supercomputers, clusters, and grids, has exposed many such issues. Importantly, these issues were not anticipated when the data was collected, and uncovering them was not trivial. As the data in this archive is used in hundreds of studies, it is necessary to describe and debate procedures that may be used to improve its data quality. Specifically, we consider issues like missing data, inconsistent data, erroneous data, system configuration changes during the logging period, and unrepresentative user behavior. Some of these may be countered by filtering out the problematic data items. In other cases, being cognizant of the problems may affect the decision of which datasets to use. While grounded in the specific domain of parallel jobs, our findings and suggested procedures can also inform similar situations in other domains. (C) 2014 Elsevier Inc. All rights reserved.
Keyword:
Workload log
Data quality
Parallel job scheduling
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Parallel and Distributed Computing 封面图
Journal of Parallel and Distributed Computing
IF:
4
论文数:
3.8K
被引数:
4.8K

机构

T
Technion Israel Institute of Technology
学者数:
1.6W
论文数: 1.5W
被引数: 2.0W
H
Hebrew University of Jerusalem
学者数:
2.8W
论文数: 2.3W
被引数: 2.7W
引用论文

引用论文

The improvement of anti-HER2 scFv soluble expression in Escherichia coli
err2020-01-01
err0
errOAAI
errFarzaneh Farshdari; Maryam Ahmadzadeh; Leila Nematollahi; Elham Mohit
err分享
err收藏
1H solid-state NMR studies of the geometry of Brønsted acid sites in zeolites H-ZSM-5
err1992-04-01
err0
PREAI
errMichael Hunger; Dieter Freude; Dieter Fenzke; Harry Pfeifer
err分享
err收藏
err分享
err收藏
Language outcomes after resection of dominant inferior parietal lobule gliomas
err2017-10-01
err0
PREAI
errDerek G. Southwell; Marco Riva; Kesshi Jordan; Eduardo Caverzasi; Jing Li; David W. Perry; Roland G. Henry; Mitchel S. Berger
err分享
err收藏
学者 查看更多内容