arrow
Return

WPIA: accelerating DNN warm-up in Web browsers by precompiling WebGL programs

delete2024-06-25
delete0
PRE
AI
D
Deyu Tian
Y
Yun Ma *
Y
Yudong Han
Q
Qi Yang
Y
Yang, Haochen
G
Gang Huang
DOI:10.1007/s11704-024-40066-wdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we study the long warm-up time of GPU acceleration of DNN inference in Web browsers. We analyzed the reason behind the long warm-up time through a measurement study and revealed that compiling WebGL programs takes most of the warm-up time. Inspired by this finding, we proposed WPIA, an approach that suggests precompiling WebGL programs on the server side to avoid compiling them in Web browsers. WPIA tackles the challenges of precompiling by merging WebGL programs and using a record-and-replay technique. Evaluation experiment results show that WPIA can accelerate the DNN warm-up time to an order of magnitude.

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146