arrow
Return

New diagonal bundle method for clustering problems in large data sets

delete2017-12-01
delete14
PRE
AI
N
Napsu Karmitsa *
A
Adil Bagirov
S
Sona Taheri
DOI:10.1016/j.ejor.2017.06.010delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Clustering is one of the most important tasks in data mining. Recent developments in computer hardware allow us to store in random access memory (RAM) and repeatedly read data sets with hundreds of thousands and even millions of data points. This makes it possible to use conventional clustering algorithms in such data sets. However, these algorithms may need prohibitively large computational time and fail to produce accurate solutions. Therefore, it is important to develop clustering algorithms which are accurate and can provide real time clustering in large data sets. This paper introduces one of them. Using nonsmooth optimization formulation of the clustering problem the objective function is represented as a difference of two convex (DC) functions. Then a new diagonal bundle algorithm that explicitly uses this structure is designed and combined with an incremental approach to solve this problem. The method is evaluated using real world data sets with both large number of attributes and large number of data points. The proposed method is compared with two other clustering algorithms using numerical results. (C) 2017 Elsevier B.V. All rights reserved.
Keywords:
Data mining
Nonsmooth optimization
Nonconvex optimization
DC function
Bundle methods
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

European Journal of Operational Research cover
European Journal of Operational Research
IF:
6
Papers:
2.2W
Citations:
6.4W

Organization

U
University of Turku
Scholars:
1.7W
Papers: 1.5W
Citations: 2.0W
F
Federation University Australia
Scholars:
2.0K
Papers: 2.3K
Citations: 17