.png){kind=icon}
Return
High-Performance Tensor Learning Primitives Using GPU Tensor Cores
.png){kind=icon}
PRE
AI
DOI：10.1109/TC.2022.3222955.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
learning is a powerful tool for big data analytics and machine learning, e.g., gene analysis and deep learning. However, tensor learning algorithms are compute-intensive since their time and space complexities grow exponentially with the order of tensors, which hinders their application. In this paper, we exploit the parallelism of tensor learning primitives using GPU tensor cores and develop high-performance tensor learning algorithms. First, we propose novel hardware-oriented optimization strategies for tensor learning primitives on GPU tensor cores. Second, for big data analytics, we employ the optimized tensor learning primitives to accelerate the CP tensor decomposition and then apply it for gene analysis. Third, we optimize the Tucker tensor decomposition and propose a novel Tucker tensor layer to compress deep neural networks. We employ natural gradients to train the neural networks, which only involve a forward pass without backpropagation and thus are suitable for GPU computations. Compared with TensorLab and TensorLy libraries on an A100 GPU, our third-order CP tensor decomposition achieves up to 16.32x and 32.25x speedups; and 6.09x and 6.72x speedups for our third-order Tucker tensor decomposition. The proposed fourth-order CP and Tucker tensor decompositions achieve up to 30.65x and 5.41x speedups over the TensorLab. Our CP tensor decomposition for gene analysis achieves up to 5.88x speedup over TensorLy. Compared with a conventional fully connected neural network, our Tucker tensor layer neural network achieves an accuracy of 97.9%, a speedup of 4.47x, and a compression ratio of 2.92 at the cost of 0.4% drop in accuracy.
Keywords:
Tensors
Graphics processing units
Matrix decomposition
Libraries
Neural networks
Deep learning
Matrix converters
Tensor learning
tensor computing
GPU tensor cores
tensor layer
neural network
Journal
IF:
3.8
Papers:
5.4K
Citations:
9.8K
Organization
Cited Papers
ShareSave
Compressing CNN-DBLSTM models for OCR with teacher-student learning and Tucker decomposition.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSave
View more