.png){kind=icon}
返回
Block-term tensor neural networks
.png){kind=icon}
OA
AI
DOI：10.1016/j.neunet.2020.05.034.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural networks (DNNs) have achieved outstanding performance in a wide range of applications, e.g., image classification, natural language processing, etc. Despite the good performance, the huge number of parameters in DNNs brings challenges to efficient training of DNNs and also their deployment in low-end devices with limited computing resources. In this paper, we explore the correlations in the weight matrices, and approximate the weight matrices with the low-rank block term tensors. We name the new corresponding structure as block-term tensor layers (BT-layers), which can be easily adapted to neural network models, such as CNNs and RNNs. In particular, the inputs and the outputs in BT-layers are reshaped into low-dimensional high-order tensors with a similar or improved representation power. Sufficient experiments have demonstrated that BT-layers in CNNs and RNNs can achieve a very large compression ratio on the number of parameters while preserving or improving the representation power of the original DNNs. (C) 2020 Elsevier Ltd. All rights reserved.
Keyword:
Tensor networks
Network compression
Neural networks
Deep learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
7.8K
被引数:
3.0W
机构
引用论文
A practical introduction to tensor networks: Matrix product states and projected entangled pair states张量网络的实用介绍: 矩阵乘积状态和投影纠缠对状态OAAI
OAAI分享收藏Contributions of Valine-292 in the Nicotinamide Binding Site of Liver Alcohol Dehydrogenase and Dynamics to Catalysis,.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏Accelerating deep neural network training with inconsistent stochastic gradient descentNEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏Heavy metal tolerance of marine phytoplankton. IV. Combined effect of zinc and cadmium on growth and uptake in some marine diatoms海洋浮游植物对重金属的耐受性。四。锌和镉对某些海洋硅藻生长和吸收的综合影响
PREAI
分享收藏Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏
查看更多内容