arrow
返回

Fast and Communication-Efficient Algorithm for Distributed Support Vector Machine Training

delete2019-05-01
delete17
PRE
AI
J
Jyotikrishna Dass *
R
Rabi Mahapatra
DOI:10.1109/TPDS.2018.2879950delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Support Vector Machines (SVM) are widely used as supervised learning models to solve the classification problem in machine learning. Training SVMs for large datasets is an extremely challenging task due to excessive storage and computational requirements. To tackle so-called big data problems, one needs to design scalable distributed algorithms to parallelize the model training and to develop efficient implementations of these algorithms. In this paper, we propose a distributed algorithm for SVM training that is scalable and communication-efficient. The algorithm uses a compact representation of the kernel matrix, which is based on the QR decomposition of low-rank approximations, to reduce both computation and storage requirements for the training stage. This is accompanied by considerable reduction in communication required for a distributed implementation of the algorithm. Experiments on benchmark data sets with up to five million samples demonstrate negligible communication overhead and scalability on up to 64 cores. Execution times are vast improvements over other widely used packages. Furthermore, the proposed algorithm has linear time complexity with respect to the number of samples making it ideal for SVM training on decentralized environments such as smart embedded systems and edge-based internet of things, IoT.
Keyword:
Machine learning
support vector machines
classification algorithms
parallel programming
distributed computing
message passing
quadratic programming
iterative algorithms
optimization
multicore processing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

T
Texas A&M University System
学者数:
4.4W
论文数: 4.0W
被引数: 4.0K
引用论文

引用论文

Percentage White: A New Feature for Ultrasound Classification of Plaque Echogenicity in Carotid Artery Atherosclerosis
err2010-02-01
err0
PREAI
errUlrica Prahl; Peter Holdfeldt; Göran Bergström; Björn Fagerberg; Johannes Hulthe; Tomas Gustavsson
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
COMMUNICATION-OPTIMAL PARALLEL AND SEQUENTIAL QR AND LU FACTORIZATIONS
err2012-01-01
err237
errOAAI
errDemmel, James; Grigori, Laura; Hoemmen, Mark; Langou, Julien
err分享
err收藏
Stereotyped: Investigating Gender in Introductory Science Courses刻板印象: 在入门科学课程中调查性别
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
err分享
err收藏
Base metal Co-fired (Na,K)NbO3 structures with enhanced piezoelectric performance
err2014-02-21
err0
PREAI
errCheng Liu; Peng Liu; Keisuke Kobayashi; Clive A. Randall
err分享
err收藏
没有更多内容