返回
An Input Weights Dependent Complex-Valued Learning Algorithm Based on Wirtinger Calculus
DOI:10.1109/TSMC.2021.3055501.png)
摘要
En 中文
Complex-valued neural network is a kind of learning model which can deal with problems in complex domain. Fully complex extreme learning machine (CELM) is a much faster training algorithm than the complex backpropagation (CBP) scheme. However, it is at the cost of using more hidden nodes to obtain the comparable performance. An upper-layer-solution-aware algorithm has been proposed for training single-hidden layer feedforward neural networks, which performs much better than its counterparts, pseudo-inverse learning (PIL)/extreme learning machine and gradient decent-based backpropagation neural networks. Consequently, there exist two challenges that need to be dealt with: 1) How to combine the advantages of CBP and CELM to develop a novel complex learning algorithm? and 2) What is the convergent behavior of the presented algorithm? In this article, an input weights dependent complex-valued (IWDCV) learning algorithm based on Wirtinger calculus has been proposed, which effectively solves the nonanalytic problem of the common activation functions during training neural networks. In addition, the monotonicity of the error function and the deterministic convergence of the proposed model have been strictly proved, which theoretically guarantee the efficiency and effectiveness of the given model, IWDCV. Finally, for real and complex-valued problems, a variety of simulations have been done to demonstrate the comparable performance of the proposed algorithm which support the theoretical observations as well.
Keyword:
Training
Neural networks
Calculus
Mathematical model
Signal processing algorithms
Backpropagation
Petroleum
Complex-valued
backpropagation (BP)
convergence
extreme learning machine (ELM)
pseudo-inverse learning (PIL)
wirtinger calculus
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Early successional trajectory of benthic community in an uninhabited reef system three years after mass coral bleaching
Coral Reefs
IF0
Is a Complex-Valued Stepsize Advantageous in Complex-Valued Gradient Learning Algorithms?复值步长在复值梯度学习算法中是有利的吗?
Regularized Weighted Circular Complex-Valued Extreme Learning Machine for Imbalanced Learning
IEEE ACCESS
IF3.6

