arrow
返回

An efficient parallel method for batched OS-ELM training using MapReduce

delete2016-04-29
delete9
PRE
AI
S
Shan Huang
B
Botao Wang *
Y
Yuemei Chen
王
王国仁 (Guoren Wang)
G
Ge Yu
DOI:10.1007/s12293-016-0190-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this era of big data, more and more models need to be trained to mine useful knowledge from large scale data. It has become a challenging problem to train multiple models accurately and efficiently so as to make full use of limited computing resources. As one of ELM variants, online sequential extreme learning machine (OS-ELM) provides a method to learn from incremental data. MapReduce, which provides a simple, scalable and fault-tolerant framework, can be utilized for large scale learning. In this paper, we propose an efficient parallel method for batched online sequential extreme learning machine (BPOS-ELM) training using MapReduce. Map execution time is estimated with historical statistics, where regression method and inverse distance weighted interpolation method are used. Reduce execution time is estimated based on complexity analysis and regression method. Based on the estimations, BPOS-ELM generates a Map execution plan and a Reduce execution plan. Finally, BPOS-ELM launches one MapReduce job to train multiple OS-ELM models according to the generated execution plan, and collects execution information to further improve estimation accuracy. Our proposal is evaluated with real and synthetic data. The experimental results show that the accuracy of BPOS-ELM is at the same level as those of OS-ELM and parallel OS-ELM (POS-ELM) with higher training efficiencies.
Keyword:
Parallel learning
Extreme learning machine
MapReduce
Sequential learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Memetic Computing 封面图
Memetic Computing
IF:
2.3
论文数:
456
被引数:
718

机构

N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

Raman study of an epitaxial GaAs layer on a Si [100] substrate
err1987-07-20
err0
errOAAI
errYihe Huang; Peter Y. Yu; Marie-Noelle Charasse; Yuhua Lo; Shyh Wang
err分享
err收藏
Extreme learning machine: Theory and applications极限学习机: 理论与应用
err2006-12-01
err1.1W
PREAI
errHuang, Guang-Bin; Zhu, Qin-Yu; Siew, Chee-Kheong
err分享
err收藏
GPU-accelerated and parallelized ELM ensembles for large-scale regression
err2011-09-01
err143
PREAI
errvan Heeswijk, Mark; Miche, Yoan; Oja, Erkki; Lendasse, Amaury
err分享
err收藏
Parallel online sequential extreme learning machine based on MapReduce
err2015-02-01
err86
PREAI
errWang, Botao; Huang, Shan; Qiu, Junhao; Liu, Yu; Wang, Guoren
err分享
err收藏
Convex incremental extreme learning machine
err2007-10-01
err959
PREAI
errHuang, Guang-Bin; Chen, Lei
err分享
err收藏
Parallel extreme learning machine for regression based on MapReduce
err2013-02-01
err141
PREAI
errHe, Qing; Shang, Tianfeng; Zhuang, Fuzhen; Shi, Zhongzhi
err分享
err收藏
学者 查看更多内容