arrow
返回

Efficient convolution pooling on the GPU

delete2020-04-01
delete11
delete
OA
AI
S
Shunsuke Suita
T
Takahiro Nishimura
H
Hiroki Tokura
K
Koji Nakano *
Y
Yasuaki Ito
A
Akihiko Kasagi
T
Tsuguchika Tabaru
DOI:10.1016/j.jpdc.2019.12.006delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The main contribution of this paper is to show efficient implementations of the convolution-pooling in the GPU, in which the pooling follows the multiple convolution. Since the multiple convolution and the pooling operations are performed alternately in earlier stages of many Convolutional Neural Networks (CNNs), it is very important to accelerate the convolution-pooling. Our new GPU implementation uses two techniques, (1) convolution interchange with direct sum, and (2) conversion to matrix multiplication. By these techniques, the computational and memory access cost are reduced. Further the convolution interchange is converted to matrix multiplication, which can be computed by cuBLAS very efficiently. Experimental results using Tesla V100 GPU show that our new GPU implementation compatible with cuDNN for the convolution-pooling is expected 2.90 times and 1.43 times faster for fp32 and fp16 than the multiple convolution and then the pooling by cuDNN, respectively. the most popular library of primitives to implement the CNNs in the GPU. (C) 2019 Elsevier Inc. All rights reserved.
Keyword:
Deep learning
Neural Networks
Convolution
Average pooling
GPU
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Parallel and Distributed Computing 封面图
Journal of Parallel and Distributed Computing
IF:
4
论文数:
3.8K
被引数:
4.8K

机构

F
fujitsu ltd
学者数:
721
论文数: 512
被引数: 2
H
Hiroshima University
学者数:
2.1W
论文数: 1.5W
被引数: 1.3W
引用论文

引用论文

Assessment of the Glue-Line Quality in Glued Laminated Timber Structures
err2013-09-01
err0
PREAI
errBettina Franke; Florian Scharmacher; Andreas Müller
err分享
err收藏
Recent advances in convolutional neural network acceleration
err2019-01-01
err245
errOAAI
errZhang, Qianru; Zhang, Meng; Chen, Tinghuan; Sun, Zhifei; Ma, Yuzhe; Yu, Bei
err分享
err收藏
err分享
err收藏
err分享
err收藏
没有更多内容