Parallel multitask cross validation for Support Vector Machine using GPU

Qi Li

doi:10.1016/j.jpdc.2012.02.011

Return

Parallel multitask cross validation for Support Vector Machine using GPU

2013-03-01

PRE

DOI：10.1016/j.jpdc.2012.02.011

Original

Original request for help

Save

Abstract

En 中文

The Support Vector Machine (SVM) is an efficient tool in machine learning with high accuracy performance. However, in order to achieve the highest accuracy performance, n-fold cross validation is commonly used to identify the best hyperparameters for SVM. This becomes a weak point of SVM due to the extremely long training time for various hyperparameters of different kernel functions. In this paper, a novel parallel SVM training implementation is proposed to accelerate the cross validation procedure by running multiple training tasks simultaneously on a Graphics Processing Unit (GPU). All of these tasks with different hyperparameters share the same cache memory which stores the kernel matrix of the support vectors: Therefore, this heavily reduces redundant computations of kernel values across different training tasks. Considering that the computations of kernel values are the most time consuming operations in SVM training, the total time cost of the cross validation procedure decreases significantly. The experimental tests indicate that the time cost for the multitask cross validation training is very close to the time cost of the slowest task trained alone. Comparison tests have shown that the proposed method is 10 to 100 times faster compared to the state of the art LIBSVM tool. (C) 2012 Elsevier Inc. All rights reserved.

Keywords:

Support Vector Machine

Cross validation

GPU

Parallel computing