.png){kind=icon}
返回
Parallel and Distributed Structured SVM Training
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2021.3101155.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Structured Support Vector Machines (structured SVMs) are a fundamental machine learning algorithm, and have solid theoretical foundation and high effectiveness in applications such as natural language parsing and computer vision. However, training structured SVMs is very time-consuming, due to the large number of constraints and inferior convergence rates, especially for large training data sets. The high cost of training structured SVMs has hindered its adoption to new applications. In this article, we aim to improve the efficiency of structured SVMs by proposing a parallel and distributed solution (namely FastSSVM) for training structured SVMs building on top of MPI and OpenMP. FastSSVM exploits a series of optimizations (e.g., optimizations on data storage and synchronization) to efficiently use the resources of the nodes in a cluster and the cores of the nodes. Moreover, FastSSVM tackles the large constraint set problem by batch processing and addresses the slow convergence challenge by adapting stop conditions based on the improvement of each iteration. We theoretically prove that our solution is guaranteed to converge to a global optimum. A comprehensive experimental study shows that FastSSVM can achieve at least four times speedup over the existing solutions, and in some cases can achieve two to three orders of magnitude speedup.
Keyword:
Training
Optimization
Support vector machines
Task analysis
Convergence
Synchronization
Natural languages
Parallel and distributed training
structured machine learning
support vector machines
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
引用论文
Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用.png)
PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏
Enhancing deep neural networks via multiple kernel learning通过多核学习增强深度神经网络PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Performance analysis of various training targets for improving speech quality and intelligibilityAPPLIED ACOUSTICS
APPLIED ACOUSTICSIF3.6
PREAI
分享收藏
查看更多内容