arrow
Return

Efficient Distributed k-Clique Mining for Large Networks Using MapReduce

delete2019-01-01
delete0
PRE
AI
S
Saeed Shahrivari *
S
Saeed Jalili
DOI:10.1109/TKDE.2019.2936027delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Mining cliques of a network is an important problem that has many applications in different fields like social networks, bioinformatics, and web analysis. In most applications, mining fixed sized cliques, known as k-cliques, is enough. However, mining cliques of a large network is very challenging using current solutions, and it takes a considerable time using a commodity machine. Also, very large networks cannot be efficiently loaded into memory of a single machine. To overcome these limitations, we have proposed a solution named KCminer, which is based on state space search and can be totally fitted into the MapReduce framework. Using the MapReduce framework, it is possible to run KCminer on cloud computing platforms and hence, process very large networks in feasible time. Our experiments which were performed on a cloud computing platform with 100 machines show that KCminer is both fast and scalable. Besides the MapReduce framework, KCminer executes efficiently on parallel shared memory systems. We performed some experiments on a commodity multicore desktop and showed that KCminer can effectively use the power of all cores. The experimental results show that even using a single thread, KCminer is much faster than available serial tools like MACE.
Keywords:
Cloud computing
Data mining
Memory management
Task analysis
Social networking (online)
Bioinformatics
Multicore processing
k-clique mining
MapReduce algorithms
parallel graph
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

T
Tarbiat Modares University
Scholars:
1.4W
Papers: 1.3W
Citations: 1.4W
Cited Papers

Cited Papers

Renal Segmental Infarction: A Cause of Reversible Malignant Hypertension
err1984-04-01
err0
PREAI
errFran??ois Elkik; Pierre Corvol; Jean-Marie Idatte; Jo??l M??nard
errShare
errSave
Quantitative Resilience Assessment of GPS, IMU, and LiDAR Sensor Fusion for Vehicle Localization Using Resilience Engineering Theory
err2023-04-11
err0
PREAI
errJohan Fanas Rojas; Parth Kadav; Nicolas Brown; Rick Meyer; Thomas Bradley; Zachary Asher
errShare
errSave
Distributed discovery of frequent subgraphs of a network using MapReduce
err2015-02-26
err18
PREAI
errShahrivari, Saeed; Jalili, Saeed
errShare
errSave
The distribution of conjunctival goblet cells in mice
err2021-03-01
err0
PREAI
errJessica Welss; Nichapa Punchago; Jessica Feldt; Friedrich Paulsen
errShare
errSave
Phase‐Contact Engineering in Mono‐ and Bimetallic Cu‐Ni Co‐catalysts for Hydrogen Photocatalytic Materials
err2018-01-11
err0
PREAI
errMario J. Muñoz‐Batista; Debora Motta Meira; Gerardo Colón; Anna Kubacka; Marcos Fernández‐García
errShare
errSave
The in vivo neurochemistry of the brain during general anesthesia
err2011-09-28
err0
errOAAI
errChristian P. Müller; Martin E. Pum; Davide Amato; Jürgen Schüttler; Joseph P. Huston; Maria A. De Souza Silva
errShare
errSave
A world review of fungi, yeasts, and slime molds in caves
err2013-01-01
err0
errOAAI
errKaren Vanderwolf; David Malloch; Donald McAlpine; Graham Forbes
errShare
errSave
A scalable, parallel algorithm for maximal clique enumeration
err2009-04-01
err111
PREAI
errSchmidt, Matthew C.; Samatova, Nagiza F.; Thomas, Kevin; Park, Byung-Hoon
errShare
errSave
researcher View more