arrow
返回

Extreme Learning Machine for Multilayer Perceptron

delete2016-04-01
delete1.2K
PRE
AI
J
Jiexiong Tang
C
Chenwei Deng *
G
Guang-Bin Huang
DOI:10.1109/TNNLS.2015.2424995delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Extreme learning machine (ELM) is an emerging learning algorithm for the generalized single hidden layer feedforward neural networks, of which the hidden node parameters are randomly generated and the output weights are analytically computed. However, due to its shallow architecture, feature learning using ELM may not be effective for natural signals (e.g., images/videos), even with a large number of hidden nodes. To address this issue, in this paper, a new ELM-based hierarchical learning framework is proposed for multilayer perceptron. The proposed architecture is divided into two main components: 1) self-taught feature extraction followed by supervised feature classification and 2) they are bridged by random initialized hidden weights. The novelties of this paper are as follows: 1) unsupervised multilayer encoding is conducted for feature extraction, and an ELM-based sparse autoencoder is developed via l1 constraint. By doing so, it achieves more compact and meaningful feature representations than the original ELM; 2) by exploiting the advantages of ELM random feature mapping, the hierarchically encoded outputs are randomly projected before final decision making, which leads to a better generalization with faster learning speed; and 3) unlike the greedy layerwise training of deep learning (DL), the hidden layers of the proposed framework are trained in a forward manner. Once the previous layer is established, the weights of the current layer are fixed without fine-tuning. Therefore, it has much better learning efficiency than the DL. Extensive experiments on various widely used classification data sets show that the proposed algorithm achieves better and faster convergence than the existing state-of-the-art hierarchical learning methods. Furthermore, multiple applications in computer vision further confirm the generality and capability of the proposed learning scheme.
Keyword:
Deep learning (DL)
deep neural network (DNN)
extreme learning machine (ELM)
multilayer perceptron (MLP)
random feature mapping
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Risk Assessment Among Prostate Cancer Patients Receiving Primary Androgen Deprivation Therapy
err2009-09-10
err0
errOAAI
errMatthew R. Cooperberg; Shiro Hinotsu; Mikio Namiki; Kazuto Ito; Jeanette Broering; Peter R. Carroll; Hideyuki Akaza
err分享
err收藏
err分享
err收藏
学者 查看更多内容