arrow
Return

Mixed-Precision Sparse Approximate Inverse Preconditioning Algorithm on GPU

delete2023-01-01
delete1
delete
OA
AI
褚新月 cover
褚新月 (Xinyue Chu) *
DOI:10.1109/ACCESS.2023.3338443delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this study, in order to further improve the construction efficiency of sparse approximate inverse (SPAI) preconditioners, we attempt to explore the construction method of SPAI preconditioners in mixed-precision mode from the perspective of single and double precision mixing, and thus propose two mixed-precision SPAI preconditioning algorithms on GPU, abbreviated as MP-SSPAI and MP-HeuriSPAI, respectively. In MP-SSPAI, with original static SPAI preconditioning algorithm as the research object, we mainly consider the following factors to construct its preconditioner in mixed-precision mode: 1) use single precision as much as possible to improve computational efficiency of the preconditioner while ensuring its validity; 2) store certain components in single precision after they have been determined to require single-precision computation to improve read efficiency; and 3) maintain the high-precision output of the preconditioner to ensure that it is computed with high precision when applied to the iterative algorithm. In MP-HeuriSPAI, a mixed-precision heuristic dynamic SPAI preconditioning algorithm on GPU is presented based on the above factors, using HeuriSPAI as the object of study. The experimental results demonstrate the effectiveness and high performance of the proposed MP-SSPAI and MP-HeuriSPAI by comparing them with their respective double-precision versions, single-precision versions, and extended versions.
Keywords:
Heuristic algorithms
Matrix decomposition
Approximation algorithms
Graphics processing units
Iterative algorithms
Sparse matrices
Minimization
GPU
mixed precision
preconditioning algorithm
sparse approximate inverse

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
Nanjing Normal University
Scholars:
1.7W
Papers: 1.3W
Citations: 1.9W
Cited Papers

Cited Papers

errShare
errSave
A survey of numerical linear algebra methods utilizing mixed-precision arithmetic
err2021-03-19
err80
PREAI
errAbdelfattah, Ahmad; Anzt, Hartwig; Boman, Erik G.; Carson, Erin; Cojean, Terry; Dongarra, Jack; Fox, Alyson; Gates, Mark; Higham, Nicholas J.; Li, Xiaoye S.; Loe, Jennifer; Luszczek, Piotr; Pranesh, Srikara; Rajamanickam, Siva; Ribizel, Tobias; Smith, Barry F.; Swirydowicz, Kasia; Thomas, Stephen; Tomov, Stanimire; Tsai, Yaohung M.; Yang, Ulrike Meier
errShare
errSave
errShare
errSave
A DYNAMIC PATTERN FACTORED SPARSE APPROXIMATE INVERSE PRECONDITIONER ON GRAPHICS PROCESSING UNITS
err2019-05-09
err11
PREAI
errBernaschi, Massimo; Carrozzo, Mauro; Franceschini, Andrea; Janna, Carlo
errShare
errSave
Role of ethylene in senescence of watercress leaves
err2006-04-28
err0
PREAI
errSonia Philosoph‐Hadas; Shimon Meir; Nehemia Aharoni
errShare
errSave
researcher View more