arrow
Return

On-GPU thread-data remapping for nested branch divergence

delete2020-05-01
delete3
PRE
AI
H
Huanxin Lin *
DOI:10.1016/j.jpdc.2020.02.003delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Nested branches are common in applications with decision trees. The more layers in the branch nest, the larger slowdown is caused by nested branch divergence on GPU. Since inner branches are impractical to evaluate on host end, thread-data remapping via GPU shared memory is so far the most suitable solution. However, existing solution cannot handle inner branches directly due to undefined behavior of GPU barrier function when executed within branch statements. Race condition needs to be prevented without using barrier function. Targeting nested divergence, we propose NeX as a nested extension scheme featuring an inter-thread protocol that supports sub-workgroup synchronization. We further exploit the on-the-fly nature of Head-or-Tail (HoT) algorithm and propose HoT2 with enhanced flexibility of wavefront scheduling. Evaluated on four GPU models including NVIDIA Volta and Turing, HoT2 confirms to be more efficient. For benchmarks with branch nests up to five-layer-deep, NeX further boosts performance by up to 1.56x. (C) 2020 Elsevier Inc. All rights reserved.
Keywords:
GPGPU
Branch divergence
SIMD
Race condition
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

U
University of Hong Kong
Scholars:
4.1W
Papers: 3.9W
Citations: 10.1W
Cited Papers

Cited Papers

A chirp-compensated, injection-seeded alexandrite laser
err2014-01-23
err0
PREAI
errP. Bakule; P.E.G. Baird; M.G. Boshier; S.L. Cornish; D.F. Heller; K. Jungmann; I.C. Lane; V. Meyer; P.H.G. Sandars; W.T. Toner; M. Towrie; J.C. Walling
errShare
errSave
Necroptosis in Solid Organ Transplantation: A Literature Overview
err2022-03-27
err0
errOAAI
errBeatrice Lukenaite; Erika Griciune; Bettina Leber; Kestutis Strupas; Philipp Stiegler; Peter Schemmer
errShare
errSave
Von Hippel-Lindau Disease with Multiple Spinal Cord Hemangioblastomas, Syringomyelia and Pheochromocytoma.
err1995-01-01
err0
errOAAI
errHisashi FURUSU; Hidenori MATSUO; Kazuhiko NAKAO; Yasuo UEDA; Wataru AOI
errShare
errSave
no more