arrow
返回

LB4OMP: A Dynamic Load Balancing Library for Multithreaded Applications

delete2022-04-01
delete4
delete
OA
AI
J
Jonas H. Müller Korndörfer *
A
Ahmed Eleliemy
A
Ali Mohammed
F
Florina M. Ciorba
DOI:10.1109/TPDS.2021.3107775delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Exascale computing systems will exhibit high degrees of hierarchical parallelism, with thousands of computing nodes and hundreds of cores per node. Efficiently exploiting hierarchical parallelism is challenging due to load imbalance that arises at multiple levels. OpenMP is the most widely-used standard for expressing and exploiting the ever-increasing node-level parallelism. The scheduling options in OpenMP are insufficient to address the load imbalance that arises during the execution of multithreaded applications. The limited scheduling options in OpenMP hinder research on novel scheduling techniques which require comparison with others from the literature. This work introduces LB4OMP, an open-source dynamic load balancing library that implements successful scheduling algorithms from the literature. LB4OMP is a research infrastructure designed to spur and support present and future scheduling research, for the benefit of multithreaded applications performance. Through an extensive performance analysis campaign, we assess the effectiveness and demystify the performance of all loop scheduling techniques in the library. We show that, for numerous applications-systems pairs, the scheduling techniques in LB4OMP outperform the scheduling options in OpenMP. Node-level load balancing using LB4OMP leads to reduced cross-node load imbalance and to improved MPI+OpenMP applications performance, which is critical for Exascale computing.
Keyword:
Dynamic scheduling
Processor scheduling
Parallel processing
Optimal scheduling
Libraries
Standards
Load management
Hierarchical parallelism
dynamic load balancing
self-scheduling
runtime library
OpenMP
multithreaded programming
shared-memory systems
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

U
University of Basel
学者数:
3.1W
论文数: 2.4W
被引数: 38
引用论文

引用论文

Unwinding Limb Development
errCell
IF0
err2016-10-01
err0
errOAAI
errDiego Villar; Duncan T. Odom
err分享
err收藏
Molecular structure of As x Se100 − x glasses studied by x-ray spectroscopy
err2007-08-01
err0
PREAI
errS. A. Kozyukhin; T. A. Kupriyanova; A. I. Vargunin
err分享
err收藏
Big data and extreme-scale computing: Pathways to Convergence-Toward a shaping strategy for a future software and data ecosystem for scientific inquiry
err2018-07-16
err79
PREAI
errAsch, M.; Moore, T.; Badia, R.; Beck, M.; Beckman, P.; Bidot, T.; Bodin, F.; Cappello, F.; Choudhary, A.; de Supinski, B.; Deelman, E.; Dongarra, J.; Dubey, A.; Fox, G.; Fu, H.; Girona, S.; Gropp, W.; Heroux, M.; Ishikawa, Y.; Keahey, K.; Keyes, D.; Kramer, W.; Lavignon, J-F; Lu, Y.; Matsuoka, S.; Mohr, B.; Reed, D.; Requena, S.; Saltz, J.; Schulthess, T.; Stevens, R.; Swany, M.; Szalay, A.; Tang, W.; Varoquaux, G.; Vilotte, J-P; Wisniewski, R.; Xu, Z.; Zacharov, I.
err分享
err收藏
The International Exascale Software Project roadmap国际Exascale软件项目路线图
err2011-01-06
err395
errOAAI
errDongarra, Jack; Beckman, Pete; Moore, Terry; Aerts, Patrick; Aloisio, Giovanni; Andre, Jean-Claude; Barkai, David; Berthou, Jean-Yves; Boku, Taisuke; Braunschweig, Bertrand; Cappello, Franck; Chapman, Barbara; Chi, Xuebin; Choudhary, Alok; Dosanjh, Sudip; Dunning, Thom; Fiore, Sandro; Geist, Al; Gropp, Bill; Harrison, Robert; Hereld, Mark; Heroux, Michael; Hoisie, Adolfy; Hotta, Koh; Jin, Zhong; Ishikawa, Yutaka; Johnson, Fred; Kale, Sanjay; Kenway, Richard; Keyes, David; Kramer, Bill; Labarta, Jesus; Lichnewsky, Alain; Lippert, Thomas; Lucas, Bob; Maccabe, Barney; Matsuoka, Satoshi; Messina, Paul; Michielse, Peter; Mohr, Bernd; Mueller, Matthias S.; Nagel, Wolfgang E.; Nakashima, Hiroshi; Papka, Michael E.; Reed, Dan; Sato, Mitsuhisa; Seidel, Ed; Shalf, John; Skinner, David; Snir, Marc; Sterling, Thomas; Stevens, Rick; Streitz, Fred; Sugar, Bob; Sumimoto, Shinji; Tang, William; Taylor, John; Thakur, Rajeev; Trefethen, Anne; Valero, Mateo; van der Steen, Aad; Vetter, Jeffrey; Williams, Peg; Wisniewski, Robert; Yelick, Kathy
err分享
err收藏
err分享
err收藏
学者 查看更多内容