arrow
Return

Damping proximal coordinate descent algorithm for non-convex regularization

delete2015-03-01
delete0
PRE
AI
P
Pan Zheng
M
Ming Lin
G
Guangdong Hou
C
Changshui Zhang *
DOI:10.1016/j.neucom.2014.11.009delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Non-convex regularization has attracted much attention in the fields of machine learning, since it is unbiased and improves the performance on many applications compared with the convex counterparts. The optimization is important but difficult for non-convex regularization. In this paper, we propose the Damping Proximal Coordinate Descent (DPCD) algorithms that address the optimization issues of a general family of non-convex regularized problems. DPCD is guaranteed to be globally convergent. The computational complexity of obtaining an approximately stationary solution with a desired precision is only linear to the data size. Our experiments on many machine learning benchmark datasets also show that DPCD has a fast convergence rate and it reduces the time of training models without significant loss of prediction accuracy. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Non-convex regularization
Non-convex optimization
Coordinate descent
Sparsity regularization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

T
tsinghua university
Scholars:
11.7W
Papers: 10.0W
Citations: 137