.png){kind=icon}
返回
DL-Reg: A deep learning regularization technique using linear regression
.png){kind=icon}
OA
AI
DOI：10.1016/j.eswa.2024.123182.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Regularization is an essential aspect in the context of deep learning as it mitigates the risk of overfitting in deep neural networks. This study presents a novel deep learning regularization method, referred to DLReg, which effectively reduces the nonlinearity of deep networks by enforcing linearity to a certain extent. The proposed method is based on the incorporation of a linear constraint into the objective function of deep neural networks, which is defined as the error of a linear mapping from the inputs to the outputs of the model. Specifically, DL -Reg imposes a linear constraint on the network, which is further adjusted by a regularization factor, thereby preventing the network from overfitting. The effectiveness of DL -Reg is evaluated by training state -of -the -art deep network models on several benchmark datasets. The results of the experiments demonstrate that the proposed regularization method provides significant improvements over existing regularization techniques and enhances the performance of deep neural networks, particularly when dealing with small-sized training datasets. The main code of DL -Reg written in PyTorch is also available here: https://github.com/m2dgithub/DL-Reg.git.
Keyword:
Deep networks
Regularization
Linear regression
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
Quality of randomness and node dropout regularization for fitting neural networks拟合神经网络的随机性质量和节点丢失正则化OAAI
OAAI分享收藏Graph convolutional neural networks with node transition probability-based message passing and DropNode regularization基于节点转移概率的消息传递和DropNode正则化的图卷积神经网络OAAI
OAAI分享收藏
分享收藏Trend Analysis on Adoption of Virtual and Augmented Reality in the Architecture, Engineering, and Construction Industry建筑、工程和建筑行业采用虚拟现实和增强现实的趋势分析.png)
DataOAAI
DataIF0
OAAI分享收藏Developing Wind and/or Solar Powered Crop Irrigation Systems for the Great Plains为大平原开发风能和/或太阳能作物灌溉系统
PREAI
分享收藏
查看更多内容