.png){kind=icon}
返回
mpi4py.futures: MPI-Based Asynchronous Task Execution for Python
.png){kind=icon}
OA
AI
DOI：10.1109/TPDS.2022.3225481.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present mpi4py.futures, a lightweight, asynchronous task execution framework targeting the Python programming language and using the Message Passing Interface (MPI) for interprocess communication. mpi4py.futures follows the interface of the concurrent.futures package from the Python standard library and can be used as its drop-in replacement, while allowing applications to scale over multiple compute nodes. We discuss the design, implementation, and feature set of mpi4py.futures and compare its performance to other solutions on both shared and distributed memory architectures. On a shared-memory system, we show mpi4py.futures to consistently outperform Python's concurrent.futures with speedup ratios between 1.4X and 3.7X in throughput (tasks per second) and between 1.9X and 2.9X in bandwidth. On a Cray XC40 system, we compare mpi4py.futures to Dask - a well-known Python parallel computing package. Although we note more varied results, we show mpi4py.futures to outperform Dask in most scenarios.
Keyword:
MPI
Python
parallelism
master-worker
parallel programming models
distributed computing
high performance computing
task execution
multiprocessing
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
引用论文
Muscle and joint‐contact loading at the glenohumeral joint after reverse total shoulder arthroplastyOAAI
.png){kind=icon}
OAAI分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏ParaCopasi: A package for parallel biochemical simulation and analysisParaCopasi: 用于并行生化模拟和分析的软件包
PREAI
分享收藏
分享收藏
查看更多内容