Double Shrinking Sparse Dimension Reduction

Tianyi Zhou

doi:10.1109/TIP.2012.2202678

Return

Double Shrinking Sparse Dimension Reduction

2013-01-01

PRE

Tianyi Zhou *

Dacheng Tao

DOI：10.1109/TIP.2012.2202678

Original

Original request for help

Save

Abstract

En 中文

Learning tasks such as classification and clustering usually perform better and cost less (time and space) on compressed representations than on the original data. Previous works mainly compress data via dimension reduction. In this paper, we propose double shrinking to compress image data on both dimensionality and cardinality via building either sparse low-dimensional representations or a sparse projection matrix for dimension reduction. We formulate a double shrinking model (DSM) as an l(1) regularized variance maximization with constraint parallel to x parallel to(2) = 1, and develop a double shrinking algorithm (DSA) to optimize DSM. DSA is a path-following algorithm that can build the whole solution path of locally optimal solutions of different sparse levels. Each solution on the path is a warm start for searching the next sparser one. In each iteration of DSA, the direction, the step size, and the Lagrangian multiplier are deduced from the Karush-Kuhn-Tucker conditions. The magnitudes of trivial variables are shrunk and the importances of critical variables are simultaneously augmented along the selected direction with the determined step length. Double shrinking can be applied to manifold learning and feature selections for better interpretation of features, and can be combined with classification and clustering to boost their performance. The experimental results suggest that double shrinking produces efficient and effective data compression.

Keywords:

Compressed sensing

dimension reduction

image compression

l(1) regularization

manifold embedding

path-following

sparse learning

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.