.png){kind=icon}
返回
Deep Neural Network Optimization Based on Binary Method for Handling Multi-Class Problems
.png){kind=icon}
PRE
AI
DOI：10.1109/ACCESS.2024.3382195.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this paper, we conceive a new kind of output layer design in deep neural networks for the multi-class problems. The traditional output layer is set by the one-to-one method. For the one-to-one method, the output layer neuron number is the same as the class number. And the ideal output for the j-th class sample is e(j) , where e(j) is j-th unit vector. However, one-to-one method requires too many output neurons, which will increase the number of weights connecting the last-hidden and the output layers. Furthermore, during the process of network training, computation time and cost will greatly increase. We design the binary method for the output layer: Let the class number be k (k >= 3), and 2(a-1) < k <= 2(a) (a = inverted right perpendicularlog2(k)inverted left perpendicular) , then the output layer neuron number is a and the ideal output is designed by binary method. Obviously, the binary method uses less output nodes than the traditional one-to-one method. On this foundation, the number of hidden-output weights will also decrease. On the other hand, while training the deep neural network, the learning efficiency will also be significantly improved. Numerical experiments show that binary method has better classification performance and calculation speed than one-to-one method on the datasets.
Keyword:
Deep neural networks
one-to-one method
binary method
multi-class problems
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.7W
机构
引用论文
Multi-scale and multi-channel neural network for click-through rate prediction.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏分享收藏Photosynthesis, transpiration and salt fluxes through leaves of Leptochloa fusca L. Kunth光合作用、蒸腾作用以及通过Leptochloa fusca L. Kunth叶片的盐分通量
PREAI
分享收藏
查看更多内容