Deep support vector neural networks

doi:10.3233/ICA-200635

Deep support vector neural networks

2020-09-11

16

PRE

AI

DOI：10.3233/ICA-200635

Original

Original request for help

Save

Abstract

En 中文

Kernel based Support Vector Machines, SVM, one of the most popular machine learning models, usually achieve top performances in two-class classification and regression problems. However, their training cost is at least quadratic on sample size, making them thus unsuitable for large sample problems. However, Deep Neural Networks (DNNs), with a cost linear on sample size, are able to solve big data problems relatively easily. In this work we propose to combine the advanced representations that DNNs can achieve in their last hidden layers with the hinge and epsilon insensitive losses that are used in two-class SVM classification and regression. We can thus have much better scalability while achieving performances comparable to those of SVMs. Moreover, we will also show that the resulting Deep SVM models are competitive with standard DNNs in two-class classification problems but have an edge in regression ones.

Keywords:

Support vector machines

deep learning

Deep support vector neural networks

Abstract

AI Summary

Journal

Organization