arrow
返回

Multiclass classification of distributed memory parallel computations

delete2013-02-01
delete9
delete
OA
AI
S
Sean Whalen *
S
Sean Peisert
M
Matt Bishop
DOI:10.1016/j.patrec.2012.10.007delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
High Performance Computing (HPC) is a field concerned with solving large-scale problems in science and engineering. However, the computational infrastructure of HPC systems can also be misused as demonstrated by the recent commoditization of cloud computing resources on the black market As a first step towards addressing this, we introduce a machine learning approach for classifying distributed parallel computations based on communication patterns between compute nodes. We first provide relevant background on message passing and computational equivalence classes called dwarfs and describe our exploratory data analysis using self organizing maps. We then present our classification results across 29 scientific codes using Bayesian networks and compare their performance against Random Forest classifiers. These models, trained with hundreds of gigabytes of communication logs collected at Lawrence Berkeley National Laboratory, perform well without any a priori information and address several shortcomings of previous approaches. (C) 2012 Elsevier B.V. All rights reserved.
Keyword:
Multiclass classification
Bayesian networks
Random forests
Self-organizing maps
High performance computing
Communication patterns
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
8.0K
被引数:
1.6W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
U
University of California Berkeley
学者数:
3.5W
论文数: 2.8W
被引数: 11.3W
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

Gender ratio in dyslexia阅读障碍的性别比例
err1998-12-01
err0
PREAI
errT. R. Miles; M. N. Haslum; T. J. Wheeler
err分享
err收藏
Bayesian network classifiers贝叶斯网络分类器
err1997-01-01
err3.8K
errOAAI
errFriedman, N; Geiger, D; Goldszmidt, M
err分享
err收藏
err分享
err收藏
err分享
err收藏
Characteristic Magnetic Resonance Imaging Findings in Spinocerebellar Ataxia 6
err1998-10-01
err0
PREAI
errYoshio Murata; Hideshi Kawakami; Shinya Yamaguchi; Masataka Nishimura; Tatsuo Kohriyama; Fumiko Ishizaki; Zenjiro Matsuyama; Yasuyo Mimori; Shigenobu Nakamura
err分享
err收藏
学者 查看更多内容