.png){kind=icon}
Return
Efficient Kernel Sparse Coding via First-Order Smooth Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2013.2294059.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We consider the problem of dictionary learning and sparse coding, where the task is to find a concise set of basis vectors that accurately represent the observation data with only small numbers of active bases. Typically formulated as an L1-regularized least-squares problem, the problem incurs computational difficulty originating from the nondifferentiable objective. Recent approaches to sparse coding thus have mainly focused on acceleration of the learning algorithm. In this paper, we propose an even more efficient and scalable sparse coding algorithm based on the first-order smooth optimization technique. The algorithm finds the theoretically guaranteed optimal sparse codes of the epsilon-approximate problem in a series of optimization subproblems, where each subproblem admits analytic solution, hence very fast and scalable with large-scale data. We further extend it to nonlinear sparse coding using kernel trick by showing that the representer theorem holds for the kernel sparse coding problem. This allows us to apply dual optimization, which essentially results in the same linear sparse coding problem in dual variables, highly beneficial compared with the existing methods that suffer from local minima and restricted forms of kernel function. The efficiency of our algorithms is demonstrated for natural stimuli data sets and several image classification problems.
Keywords:
Dictionary learning
first-order smooth optimization
kernel representer theorem
sparse coding
Journal
IF:
8.9
Papers:
7.7K
Citations:
8.0W
Organization
No organization information available
Cited Papers
ShareSaveT-786C Polymorphism in Promoter of eNOS Gene as Genetic Risk Factor in Patients With Erectile Dysfunction in Turkish Population.png)
Urology
UrologyIF0
PREAI
ShareSaveRepresenting and recognizing the visual appearance of materials using three-dimensional textons
PREAI
ShareSave
ShareSaveShareSave
View more