arrow
返回

A Modular Approximation Methodology for Efficient Fixed-Point Hardware Implementation of the Sigmoid Function

delete2022-10-01
delete20
PRE
AI
Z
Zhe Pan
Z
Zonghua Gu
X
Xiaohong Jiang
G
Guoquan Zhu
D
De Ma *
DOI:10.1109/TIE.2022.3146573delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The sigmoid function is a widely used nonlinear activation function in neural networks. In this article, we present a modular approximation methodology for efficient fixed-point hardware implementation of the sigmoid function. Our design consists of three modules: piecewise linear (PWL) approximation as the initial solution, Taylor series approximation of the exponential function, and Newton-Raphson method-based approximation as the final solution. Its modularity enables the designer to flexibly choose the most appropriate approximation method for each module separately. Performance evaluation results indicate that our work strikes an appropriate balance among the objectives of approximation accuracy, hardware resource utilization, and performance.
Keyword:
Hardware
Taylor series
Newton method
Approximation error
Artificial neural networks
Quantization (signal)
Input variables
Artificial neural networks (NNs)
FPGA
hardware acceleration
Newton-Raphson (NR) method
sigmoid function

期刊

IEEE Transactions on Industrial Electronics 封面图
IEEE Transactions on Industrial Electronics
IF:
7.2
论文数:
1.8W
被引数:
9.8W

机构

Z
Zhejiang Laboratory
学者数:
1.8K
论文数: 1.7K
被引数: 0
U
Umea University
学者数:
1.4W
论文数: 1.4W
被引数: 134
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

An optimal combination of five main monomer components in Wuzi Yanzong Pill that prevents neural tube defects and reduces apoptosis and oxidative stress
err2023-09-01
err0
PREAI
errXinliang Wang; Chanjuan Yang; Yi Ru; Liangqi Xie; Baoguo Xiao; Xiaoming Jin; Cungen Ma; Zhi Chai; Huijie Fan
err分享
err收藏
Memristive LSTM Network for Sentiment Analysis用于情感分析的忆阻LSTM网络
err2019-01-01
err110
PREAI
errWen, Shiping; Wei, Huaqiang; Yang, Yin; Guo, Zhenyuan; Zeng, Zhigang; Huang, Tingwen; Chen, Yiran
err分享
err收藏
Binary neural networks: A survey
err2020-09-01
err303
errOAAI
errQin, Haotong; Gong, Ruihao; Liu, Xianglong; Bai, Xiao; Song, Jingkuan; Sebe, Nicu
err分享
err收藏
Optimal Cost Function Parameter Design in Predictive Torque Control (PTC) Using Artificial Neural Networks (ANN)
err2021-08-01
err79
errOAAI
errNovak, Mateja; Xie, Haotian; Dragicevic, Tomislav; Wang, Fengxiang; Rodriguez, Jose; Blaabjerg, Frede
err分享
err收藏
err分享
err收藏
Hardware Implementation and Real-Time Evaluation of an ANN-Based Algorithm for Anti-Islanding Protection of Distributed Generators
err2018-06-01
err25
PREAI
errHartmann, Nolman Barroso; dos Santos, Ricardo Caneloi; Grilo, Ahda Pionkoski; Melo Vieira, Jose Carlos
err分享
err收藏
学者 查看更多内容