Patch clustering for massive data sets

Nikolai Alex

doi:10.1016/j.neucom.2008.12.026

Return

Patch clustering for massive data sets

2009-03-01

PRE

Nikolai Alex

Alexander Hasenfuß

Barbara Hammer *

DOI：10.1016/j.neucom.2008.12.026

Original

Original request for help

Save

Abstract

En 中文

The presence of huge data sets poses new problems to popular clustering and visualization algorithms such as neural gas (NG) and the self-organising-map (SOM) due to memory and time constraints. In such situations, it is no longer possible to store all data points in the main memory at once and only a few, ideally only one run over the whole data set is still affordable to achieve a feasible training time. In this contribution we propose single pass extensions of the classical clustering algorithms NG and SOM which are based on a simple patch decomposition of the data set and fast batch optimization schemes of the underlying cost function. The algorithms only require a fixed memory space. They maintain the benefits of the original ones including easy implementation and interpretation as well as large flexibility and adaptability. We demonstrate that parallelization of the methods becomes easily possible and we show the efficiency of the approach in a variety of experiments. (C) 2009 Elsevier B.V. All rights reserved.

Keywords:

Neural gas

Clustering streaming data

Parallelization

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.