arrow
Return

A pseudo-softmax function for hardware-based high speed image classification

delete2021-07-28
delete30
delete
OA
AI
C
Cardarilli, Gian Carlo
L
Luca Di Nunzio
R
Rocco Fazzolari
D
Daniele Giardino
A
Alberto Nannarelli
M
M. Re
S
Sergio Spanò *
DOI:10.1038/s41598-021-94691-7delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this work a novel architecture, named pseudo-softmax, to compute an approximated form of the softmax function is presented. This architecture can be fruitfully used in the last layer of Neural Networks and Convolutional Neural Networks for classification tasks, and in Reinforcement Learning hardware accelerators to compute the Boltzmann action-selection policy. The proposed pseudo-softmax design, intended for efficient hardware implementation, exploits the typical integer quantization of hardware-based Neural Networks obtaining an accurate approximation of the result. In the paper, a detailed description of the architecture is given and an extensive analysis of the approximation error is performed by using both custom stimuli and real-world Convolutional Neural Networks inputs. The implementation results, based on CMOS standard-cell technology, compared to state-of-the-art architectures show reduced approximation errors.
Keywords:
IMPLEMENTATION
ARCHITECTURE
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.4W
Citations:
83.5W

Organization

T
technical university of denmark
Scholars:
2.6W
Papers: 2.8W
Citations: 37
U
University of Rome Tor Vergata
Scholars:
2.5W
Papers: 1.8W
Citations: 2.0W