.png){kind=icon}
返回
A framework for exploiting task and data parallelism on distributed memory multicomputers
.png){kind=icon}
PRE
AI
DOI：10.1109/71.642945.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Distributed Memory Multicomputers (DMMs), such as the IBM SP-2, the Intel Paragon. and the Thinking Machines CM-5, offer significant advantages over shared memory multiprocessors in terms of cost and scalability, Unfortunately, the utilization of all the available computational power in these machines involves a tremendous programming effort on the part of users, which creates a need for sophisticated compiler and run-time support for distributed memory machines. In this paper, we explore a new compiler optimization for regular scientific applications-the simultaneous exploitation of task and data parallelism. Our optimization is implemented as part of the PARADIGM HPF compiler framework we have developed. The intuitive idea behind the optimization is the use of task parallelism to control the degree of data parallelism of individual tasks. The reason this provides increased performance is that data parallelism provides diminishing returns as the number of processors used is increased. By controlling the number of processors used for each data parallel task in an application and by concurrently executing these tasks, we make program execution more efficient and, therefore, faster. A practical implementation of a task and data parallel scheme of execution for an application on a distributed memory multicomputer also involves data redistribution. This data redistribution causes an overhead. However, as our experimental results show, this overhead is not a problem; execution of a program using task and data parallelism together can be significantly faster than its execution using data parallelism alone. This makes our proposed optimization practical and extremely useful.
Keyword:
task parallel
data parallel
allocation
scheduling
HPF
distributed memory
convex programming
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
暂无机构信息
引用论文
分享收藏Apathy Antedating and Evolving With Dementia: A Case Report and Insights Into Apathy as a Network Dysfunction.png)
Cureus
OAAI
CureusIF0
OAAI分享收藏
查看更多内容