arrow
Return

A parallel algorithm for mining constrained frequent patterns using MapReduce

delete2015-11-17
delete19
PRE
AI
X
Xiaowu Yan
张
张继福 (Jifu Zhang) *
荀
荀亚玲 (Yaling Xun)
X
Xiao Qin
DOI:10.1007/s00500-015-1930-zdelete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Constrained frequent pattern refers to a frequent pattern generated using constrained conditions given by users and has characteristics of stronger pertinence, higher practicability and mining efficiency, etc. With the increasing of datasets, there are defects during the construction of the constrained frequent pattern tree, so that the constrained frequent pattern tree is difficult to apply to massive datasets. In this paper, a parallel mining algorithm of the constrained frequent pattern, called PACFP, is proposed using the MapReduce programming model. First, key steps in the algorithm, such as mapping transaction in datasets to frequent item support count, constructing the constrained frequent pattern tree, generating the constrained frequent pattern, and aggregating frequent patterns, are implemented by three pairs of Map and Reduce functions. Second, migration of data recording is achieved by applying a data grouping strategy based on frequent item support, and load balance is effectively solved while generating the constrained frequent pattern. In the end, experimental results validate availability, scalability, and expandability of the algorithm using celestial spectrum datasets.
Keywords:
Association rule
Constrained frequent pattern
MapReduce
Frequent item support
Load balance

Journal

Soft Computing cover
Soft Computing
IF:
2.5
Papers:
1.0W
Citations:
2.1W

Organization

T
taiyuan university of science & technology
Scholars:
3.5K
Papers: 2.3K
Citations: 3
A
auburn university system
Scholars:
1.1W
Papers: 9.5K
Citations: 9
Cited Papers

Cited Papers

Interrelation analysis of celestial spectra data using constrained frequent pattern trees
err2013-03-01
err16
PREAI
errZhang, Jifu; Zhao, Xujun; Zhang, Sulan; Yin, Shu; Qin, Xiao
errShare
errSave
The use of physical energy for tissue healing
err2015-03-10
err0
errOAAI
errC. Ventura; F. Bianchi; C. Cavallini; E. Olivi; R. Tassinari
errShare
errSave
errShare
errSave
Phytoplankton primary productivity in the euphotic zone of the California Current System estimated from CZCS imagery
err2007-03-07
err0
errOAAI
errOA Barocio-León; R Millán-Núñez; E Santamaría-del-Ángel; A González-Silvera
errShare
errSave
Overview of the Cell Cycle
err2001-05-01
err0
PREAI
errMichele S. Park; Andrew Koff
errShare
errSave
researcher View more