Feature selection for unsupervised learning through local learning

Jin Yao

doi:10.1016/j.patrec.2014.11.006

Feature selection for unsupervised learning through local learning

2015-02-01

28

PRE

AI

DOI：10.1016/j.patrec.2014.11.006

Original

Original request for help

Save

Abstract

En 中文

We consider the problem of feature selection for unsupervised learning and develop a new algorithm capable of identifying informative features supporting complex structures embedded in a high-dimensional space. The development of the algorithm is inspired by human learning in detecting complex data structures. We formulate it as an optimization problem with a well-defined objective function, and solve the problem by using an iterative approach. The algorithm can be easily implemented and is computationally very efficient. We use gap statistics to estimate the parameters so that the proposed method is completely parameter-free. We also develop a scheme based on permutation tests to estimate the statistical significance of the presence of a data structure. We demonstrate the effectiveness and versatility of the algorithm by comparing it with seven existing methods on a set of synthetic datasets with a wide variety of structures and cancer microarray gene expression datasets. (C) 2014 Elsevier B.V. All rights reserved.

Keywords:

Feature selection

Unsupervised learning

Clustering

Manifold learning

Feature selection for unsupervised learning through local learning

Abstract

AI Summary

Journal

Organization