arrow
Return

Identifying frequent items in distributed data sets

delete2012-11-15
delete6
PRE
AI
J
Jan Šácha *
A
Alberto Montresor
DOI:10.1007/s00607-012-0220-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Many practical problems in computer science require the knowledge of the most frequently occurring items in a data set. Current state-of-the-art algorithms for frequent items discovery are either fully centralized or rely on node hierarchies which are inflexible and prone to failures in massively distributed systems. In this paper we describe a family of gossip-based algorithms that efficiently approximate the most frequent items in large-scale distributed datasets. We show, both analytically and using real-world datasets, that our algorithms are fast, highly scalable, and resilient to node failures.
Keywords:
Frequency
Most-frequent
Distributed
Decentralized
Gossip
Aggregation

Journal

C
Computing
IF:
2.8
Papers:
2.3K
Citations:
3.5K

Organization

U
University of Trento
Scholars:
8.8K
Papers: 9.0K
Citations: 1.2W
A
alcatel-lucent
Scholars:
997
Papers: 728
Citations: 2