.png){kind=icon}
返回
A note on factor normalization for deep neural network models
.png){kind=icon}
OA
AI
DOI：10.1038/s41598-022-09910-6.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural network (DNN) models often involve high-dimensional features. In most cases, these high-dimensional features can be decomposed into two parts: a low-dimensional factor and residual features with much-reduced variability and inter-feature correlation. This decomposition has several interesting theoretical implications for DNN training. Based on these implications, we develop a novel factor normalization method for better performance. The proposed method leads to a new deep learning model with two important characteristics. First, it allows factor-related feature extraction, and second, it allows for adaptive learning rates for factors and residuals. These model features improve the convergence speed on both training and testing datasets. Multiple empirical experiments are presented to demonstrate the model's superior performance.
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.9
论文数:
28.3W
被引数:
83.5W
机构
引用论文
Facile Synthesis, Characterization, Nanocrystal Growth and Photoluminescence Properties of GeS Nanowires.png)
Nano
NanoIF0
PREAI
分享收藏Mechanical, but not infective, pacemaker erosion may be successfully managed by re-implantation of pacemakers.HeartOAAI
HeartIF0
OAAI分享收藏分享收藏Who Knows, who Cares? Dementia Knowledge among Nurses, Care Workers, and Family members of People Living with Dementia谁知道，谁在乎？痴呆症患者的护士，护理人员和家庭成员的痴呆症知识OAAI
OAAI分享收藏
查看更多内容