arrow
返回

Online ADMM-Based Extreme Learning Machine for Sparse Supervised Learning

delete2019-01-01
delete10
delete
OA
AI
T
Tianheng Song
D
Dazi Li *
Z
Zhiyin Liu
W
Weimin Yang
DOI:10.1109/ACCESS.2019.2915970delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Sparse learning is an efficient technique for feature selection and avoiding overfitting in machine learning research areas. Considering sparse learning for real-world problems with online learning demands in neural networks, an online sparse supervised learning of extreme learning machine (ELM) algorithm is proposed based on alternative direction method of multipliers (ADMM), termed OAL1-ELM. In OAL1-ELM, an l(1)-regularization penalty is added in loss function for generating a sparse solution to enhance the generalization ability. This convex combinatorial loss function is solved by using ADMM in a distributed way. Furthermore, an improved ADMM is used to reduce computational complexity and to achieve online learning. The proposed algorithm can learn data one-by-one or batch-by-batch. The convergence analysis for the fixed point of the solution is given to show the efficiency and optimality of the proposed method. The experimental results show that the proposed method can obtain a sparse solution and have strong generalization performance in a wide range of regression tasks, multiclass classification tasks, and a real-world industrial project.
Keyword:
Online learning
alternative direction method of multipliers (ADMM)
l(1)-regularization
extreme learning machine (ELM)
sparse output parameters
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

B
Beijing University of Chemical Technology
学者数:
3.1W
论文数: 2.2W
被引数: 4.5W
引用论文

引用论文

Sparse Proximal Reinforcement Learning via Nested Optimization
err2020-11-01
err3
PREAI
errSong, Tianheng; Li, Dazi; Jin, Qibing; Hirasawa, Kotaro
err分享
err收藏
Sparse Extreme Learning Machine for Classification
err2014-10-01
err185
errOAAI
errBai, Zuo; Huang, Guang-Bin; Wang, Danwei; Wang, Han; Westover, M. Brandon
err分享
err收藏
Explicit and implicit reinforcement learning across the psychosis spectrum.
err2017-07-01
err0
errOAAI
errDeanna M. Barch; Cameron S. Carter; James M. Gold; Sheri L. Johnson; Ann M. Kring; Angus W. MacDonald; Diego A. Pizzagalli; J. Daniel Ragland; Steven M. Silverstein; Milton E. Strauss
err分享
err收藏
Feed forward neural network with random quaternionic neurons具有随机四元数神经元的前馈神经网络
err2017-07-01
err46
PREAI
errMinemoto, Toshifumi; Isokawa, Teijiro; Nishimura, Haruhiko; Matsui, Nobuyuki
err分享
err收藏
err分享
err收藏
学者 查看更多内容