.png){kind=icon}
返回
HW/SW Codesign for Approximation-Aware Binary Neural Networks
.png){kind=icon}
PRE
AI
DOI：10.1109/JETCAS.2023.3243267.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Binary Neural Networks (BNNs) are rapidly gaining remarkable attention due to their superiority in shrinking the model size, which outstandingly mitigates the fundamental memory wall bottleneck that is attributed to the existing vonNeumann architectures. This work investigates how principles from approximate computing can be effectively employed to further optimize BNNs. It demonstrates that HW/SW codesign, in which BNNs are either proactively trained in the presence of approximation-induced errors (i.e. design-time optimization) and/or augmented with an appropriate error-mitigation scheme (i.e., run-time optimization), is a key to realize energy-efficient yet robust BNNs. We unveil, for the first time, that although the underlying HW of BNNs can be implemented using simple XNOR gates, the complexity of the required Popcount circuit superlinearly grows with the filter kernel size. This largely impacts the area footprint, inference time, energy, and hence it severely constricts the prospective efficiency gains from BNNs. To overcome this challenge, we replace the accurate full adders constructing the Popcount with Majority gates that approximately perform the required additions. Then, our carefully-crafted error-mitigation scheme along with activations tuning considerably minimizes the induced errors. Afterward, abstracted error probabilities are derived and employed during BNN training to obtain approximation-aware BNNs, that are inherently robust against the underlying HW approximation. Differently from the typical approaches, the proposed HW/SW codesign methodology has the merit of allowing a training of the approximate BNN without the need to modify the existing software frameworks (i.e., PyTorch). This is of great importance since existing tools rely on efficient built-in functions that can be difficult and/or inefficient to be modified. An FPGA-based SoC realizing both accurate and approximation-aware BNNs is developed for validating our proposed methodology. With merely a 4.7% loss in the inference accuracy, our HW/SW codesign leads to 64% and 80.2% savings in the area and energy, respectively, at the parity of the latency. Our results are obtained using commercial EDA tool flows employing a commercial 28nm FDSOI technology node.
Keyword:
Approximate computing
neural network
low-power design
FPGA
期刊
IF:
3.8
论文数:
1.4K
被引数:
2.8K
机构
引用论文
A Theoretical Framework for Quality Estimation and Optimization of DSP Applications Using Low-Power Approximate Adders使用低功耗近似加法器的DSP应用质量估计和优化的理论框架
.png){kind=icon}
PREAI
分享收藏FeFET-Based Binarized Neural Networks Under Temperature-Dependent Bit Errors基于FeFET的二值化神经网络在温度相关误码下的应用
OAAI
OAAI分享收藏
分享收藏
查看更多内容