Distributed data clustering over networks

doi:10.1016/j.patcog.2019.04.021

Return

Distributed data clustering over networks

2019-09-01

PRE

Paolo Di Lorenzo

Massimo Panella *

DOI：10.1016/j.patcog.2019.04.021

Original

Original request for help

Save

Abstract

En 中文

In this paper, we consider the problem of distributed unsupervised clustering, where training data is partitioned over a set of agents, whose interaction happens over a sparse, but connected, communication network. To solve this problem, we recast the well known Expectation Maximization method in a distributed setting, exploiting a recently proposed algorithmic framework for in-network non-convex optimization. The resulting algorithm, termed as Expectation Maximization Consensus, exploits successive local convexifications to split the computation among agents, while hinging on dynamic consensus to diffuse information over the network in real-time. Convergence to local solutions of the distributed clustering problem is then established. Experimental results on well-known datasets illustrate that the proposed method performs better than other distributed Expectation-Maximization clustering approaches, while the method is faster than a centralized Expectation-Maximization procedure and achieves a comparable performance in terms of cluster validity indexes. The latter ones achieve good values in absolute range scales and prove the quality of the obtained clustering results, which compare favorably with other methods in the literature. (C) 2019 Elsevier Ltd. All rights reserved.

Keywords:

Distributed learning

Clustering

Gaussian mixtures

Expectation maximization

Non-Convex optimization

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.