arrow
返回

Optimizing Iterative Data-Flow Scientific Applications Using Directed Cyclic Graphs

delete2023-01-01
delete0
delete
OA
AI
D
David Álvarez *
V
Vicenç Beltrán
DOI:10.1109/ACCESS.2023.3269902delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data-flow programming models have become a popular choice for writing parallel applications as an alternative to traditional work-sharing parallelism. They are better suited to write applications with irregular parallelism that can present load imbalance. However, these programming models suffer from overheads related to task creation, scheduling and dependency management, limiting performance and scalability when tasks become too small. At the same time, many HPC applications implement iterative methods or multi-step simulations that create the same directed acyclic graphs of tasks on each iteration. By giving application programmers a way to express that a specific loop is creating the same task pattern on each iteration, we can create a single task directed acyclic graph (DAG) once and transform it into a cyclic graph. This cyclic graph is then reused for successive iterations, minimizing task creation and dependency management overhead. This paper presents the taskiter, a new construct we propose for the OmpSs-2 and OpenMP programming models, allowing the use of directed cyclic task graphs (DCTG) to minimize runtime overheads. Moreover, we present a simple immediate successor locality-aware heuristic that minimizes task scheduling overhead by bypassing the runtime task scheduler. We evaluate the implementation of the taskiter and the immediate successor heuristic in 8 iterative benchmarks. Using small task granularities, we obtain a geometric mean speedup of 2.56x over the reference OmpSs-2 implementation, and a 3.77x and 5.2x speedup over the LLVM and GCC OpenMP runtimes, respectively.
Keyword:
Taskiter
data-flow programming
ompss-2
openmp
iterative applications

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
universitat politecnica de catalunya
学者数:
1.9W
论文数: 1.6W
被引数: 17
引用论文

引用论文

Time-Dependent Statistical and Correlation Properties of Neural Signals during Handwriting
err2012-09-11
err0
errOAAI
errValery I. Rupasov; Mikhail A. Lebedev; Joseph S. Erlichman; Stephen L. Lee; James C. Leiter; Michael Linderman
err分享
err收藏
An analytical formula for ring artefact suppression in X-ray tomography
err2010-12-01
err0
PREAI
errSofya Titarenko; Philip J. Withers; Anatoly Yagola
err分享
err收藏
Feasibility of Computer-Based Videogame Therapy for Children with Cerebral Palsy
err2013-08-01
err0
errOAAI
errSandra Radtka; Robert Hone; Charles Brown; Judy Mastick; Marsha E. Melnick; Glenna A. Dowling
err分享
err收藏
Evaluation of NCS-1, DARPP-32, and neurotrophins in hippocampus and prefrontal cortex in rats submitted to sepsis
err2014-07-16
err0
PREAI
errClarissa M. Comim; Napoleão C. Silva; Francielle Mina; Diogo Dominguini; Giselli Scaini; Meline O.S. Morais; Daniela V. Rosa; Luiz Alexandre V. Magno; Emilio L. Streck; Marco A. Romano-Silva; João Quevedo; Felipe Dal-Pizzol
err分享
err收藏
A unitary mechanism underlies adaptation to both local and global environmental statistics in time perception
err2023-05-05
err0
errOAAI
errTianhe Wang; Yingrui Luo; Richard B. Ivry; Jonathan S. Tsay; Ernst Pöppel; Yan Bao
err分享
err收藏
err分享
err收藏
学者 查看更多内容