arrow
返回

Sample-based online learning for bi-regular hinge loss

delete2021-01-24
delete4
PRE
AI
W
Wei Xue *
P
Ping Zhong *
张
张文胜 (Wensheng Zhang)
G
Gaohang Yu
Y
Yebin Chen
DOI:10.1007/s13042-020-01272-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Support vector machine (SVM), a state-of-the-art classifier for supervised classification task, is famous for its strong generalization guarantees derived from the max-margin property. In this paper, we focus on the maximum margin classification problem cast by SVM and study the bi-regular hinge loss model, which not only performs feature selection but tends to select highly correlated features together. To solve this model, we propose an online learning algorithm that aims at solving a non-smooth minimization problem by alternating iterative mechanism. Basically, the proposed algorithm alternates between intrusion samples detection and iterative optimization, and at each iteration it obtains a closed-form solution to the model. In theory, we prove that the proposed algorithm achieves O(1/root T) convergence rate under some mild conditions, where T is the number of training samples received in online learning. Experimental results on synthetic data and benchmark datasets demonstrate the effectiveness and performance of our approach in comparison with several popular algorithms, such as LIBSVM, SGD, PEGASOS, SVRG, etc.
Keyword:
SVM
Max-margin classification
Hinge loss
Elastic net
Online learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Machine Learning and Cybernetics 封面图
International Journal of Machine Learning and Cybernetics
IF:
2.7
论文数:
3.2K
被引数:
5.6K

机构

A
anhui university of technology
学者数:
9.6K
论文数: 5.6K
被引数: 9
I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

An analysis of four different methods of producing focal cerebral ischemia with endothelin-1 in the rat
err2006-10-01
err0
PREAI
errV WINDLE; A SZYMANSKA; S GRANTERBUTTON; C WHITE; R BUIST; J PEELING; D CORBETT
err分享
err收藏
Diseases and Molecular Diagnostics: A Step Closer to Precision Medicine
err2017-08-22
err0
errOAAI
errShailendra Dwivedi; Purvi Purohit; Radhieka Misra; Puneet Pareek; Apul Goel; Sanjay Khattri; Kamlesh Kumar Pant; Sanjeev Misra; Praveen Sharma
err分享
err收藏
err分享
err收藏
学者 查看更多内容