.png){kind=icon}
返回
CANNON: Communication-Aware Sparse Neural Network Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TETC.2023.3289778.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Sparse deep neural networks (DNNs) have the potential to deliver compelling performance and energy efficiency without significant accuracy loss. However, their benefits can quickly diminish if their training is oblivious to the target hardware. For example, fewer critical connections can have a significant overhead if they translate into long-distance communication on the target hardware. Therefore, hardware-aware sparse training is needed to leverage the full potential of sparse DNNs. To this end, we propose a novel and comprehensive communication-aware sparse DNN optimization framework for tile-based in-memory computing (IMC) architectures. The proposed technique, CANNON first maps the DNN layers onto the tiles of the target architecture. Then, it replaces the fully connected and convolutional layers with communication-aware sparse connections. After that, CANNON optimizes the communication cost with minimal impact on the DNN accuracy. Extensive experimental evaluations with a wide range of DNNs and datasets show up to 3.0x lower communication energy, 3.1x lower communication latency, and 6.8x lower energy-delay product compared to state-of-the-art pruning approaches with a negligible impact on the classification accuracy on IMC-based machine learning accelerators.
Keyword:
Hardware-aware pruning
communication-aware pruning
mapping
sparse neural networks
期刊
IF:
5.4
论文数:
1.1K
被引数:
3.4K
机构
引用论文
.png){kind=icon}
Faculty Attitudes towards Persons with Disabilities when Controlling for Attitudes toward Diversity
PREAI
分享收藏
Structured Pruning of RRAM Crossbars for Efficient In-Memory Computing Acceleration of Deep Neural NetworksRRAM Crossbars的结构化修剪，用于深度神经网络的高效内存计算加速
PREAI
分享收藏分享收藏分享收藏
查看更多内容