.png){kind=icon}
返回
A step function based recursion method for 0/1 deep neural networks
.png){kind=icon}
PRE
AI
DOI：10.1016/j.amc.2024.129129.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The deep neural network with step function activation (0/1 DNNs) is a fundamental composite model in deep learning which has high efficiency and robustness to outliers. However, due to the discontinuity and lacking subgradient information of the 0/1 DNNs model, prior researches are largely focused on designing continuous functions to approximate the step activation and developing continuous optimization methods. In this paper, by introducing two sets of network node variables into the 0/1 DNNs and by exploring the composite structure of the resulted model, the 0/1 DNNs is decomposed into a unary optimization model associated with the step function and three derivational optimization subproblems associated with the other variables. For the unary optimization model and two derivational optimization subproblems, we present a closed form solution, and for the third derivational optimization subproblem, we propose an efficient proximal method. Based on this, a globally convergent step function based recursion method for the 0/1 DNNs is developed. The efficiency and performance of the proposed algorithm are validated via theoretical analysis as well as some illustrative numerical examples on classifying MNIST, FashionMNIST and Cifar10 datasets.
Keyword:
0/1 DNNs
Step function
Separability
Recursion method
期刊
IF:
3.4
论文数:
2.3W
被引数:
3.3W
机构
引用论文
Deep learning for unmanned aerial vehicles detection: A review深度学习在无人机检测中的应用综述.png)
COMPUTER SCIENCE REVIEW
COMPUTER SCIENCE REVIEWIF12.7
PREAI
分享收藏Two-dimensional bricklayer arrangements of tolans using halogen bonding interactions使用卤素键相互作用的tolans的二维瓦工层布置
PREAI
分享收藏Toward Compact ConvNets via Structure-Sparsity Regularized Filter Pruning通过结构稀疏正则化滤波器修剪实现紧凑的ConvNets
PREAI
分享收藏Recent Advances in Drug Design and Delivery Across Biological Barriers
Using Computational Models
PREAI
分享收藏分享收藏Segment anything model for medical image analysis: An experimental studyMEDICAL IMAGE ANALYSIS
OAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏Deep Learning Enabled Semantic Communications With Speech Recognition and Synthesis通过语音识别和合成实现深度学习的语义通信OAAI
OAAI分享收藏
查看更多内容