arrow
返回

Learning with smooth Hinge losses

delete2021-11-01
delete14
delete
OA
AI
J
Junru Luo
H
Hong Qiao
B
Bo Zhang *
DOI:10.1016/j.neucom.2021.08.060delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Due to the non-smoothness of the Hinge loss in SVM, it is difficult to obtain a faster convergence rate with modern optimization algorithms. In this paper, we introduce two smooth Hinge losses psi(G)(alpha, sigma) and psi(M)(alpha; sigma) which are infinitely differentiable and converge to the Hinge loss uniformly in alpha as sigma tends to 0. By replacing the Hinge loss with these two smooth Hinge losses, we obtain two smooth support vector machines (SSVMs), respectively. Solving the SSVMs with the Trust Region Newton method (TRON) leads to two quadratically convergent algorithms. Experiments in text classification tasks show that the proposed SSVMs are effective in real-world applications. We also introduce a general smooth convex loss function to unify several commonly-used convex loss functions in machine learning. The general framework provides smooth approximation functions to non-smooth convex loss functions, which can be used to obtain smooth models that can be solved with faster convergent optimization algorithms. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Smooth Hinge loss
Convex surrogate loss
Support vector machine
Trust region Newton method
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

C
Changzhou University
学者数:
1.4W
论文数: 8.3K
被引数: 1.1W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Effect of alkylaluminum cocatalyst on ethylene polymerization with nickel-α-diimine complex
err2007-05-01
err0
PREAI
errCaroline G. de Souza; Roberto F. de Souza; Katia Bernardo-Gusmão
err分享
err收藏
err分享
err收藏
α-Haloenolates of Esters; III.- A Novel High-Yield Preparation of α,α-Dichloroesters
err1975-01-01
err0
PREAI
errJ. VILLIERAS; J. R. DISNAR; P. PERRIOT; J. F. NORMANT
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容