.png){kind=icon}
返回
A generalized Lorenz system-based initialization method for deep neural networks
.png){kind=icon}
PRE
AI
DOI：10.1016/j.asoc.2024.112316.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural networks (DNNs) are a powerful tool for solving complex problems. The effectiveness of DNNs largely depends on the initialization technique used. This research develops a new initialization method for DNNs that uses chaotic sequences from the generalized Lorenz system to improve their performance. The proposed method, termed Generalized Lorenz Initialization (GLI), has been compared with two established initialization methods (Kaiming and Xavier) across four different DNN architectures: Informer, Neural Basis Expansion Analysis for Interpretable Time Series, Long Short-Term Memory, and NeuRewriter. The performance of these methods has been evaluated on seven time series forecasting datasets and one combinatorial optimization dataset. Results show that the GLI method improved forecasting accuracy by up to 86.47% compared to the Kaiming method and 88.86% compared to the Xavier method across all time series datasets. For the combinatorial optimization task, the GLI method reduced computational time by up to 9.24% with the better solution quality. These indicate the superiority of the GLI method over the two representative initialization methods for different DNN architectures across different problem domains.
Keyword:
Initialization method
Generalized Lorenz system
Deep neural networks
Time series forecasting
Combinatorial optimization
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
A deep neural network with modified random forest incremental interpretation approach for diagnosing diabetes in smart healthcare基于改进随机森林增量解释的深度神经网络在智能医疗糖尿病诊断中的应用
PREAI
分享收藏Improving deep neural networks with multi-layer maxout networks and a novel initialization method.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏Conglomeration of deep neural network and quantum learning for object detection: Status quo review
PREAI
分享收藏Automatic recognition of holistic functional brain networks using iteratively optimized convolutional neural networks (IO-CNN) with weak label initializationMEDICAL IMAGE ANALYSIS
OAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏SW-ELM: A summation wavelet extreme learning machine algorithm with a priori parameter initializationNEUROCOMPUTINGOAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏
查看更多内容