arrow
返回

Iterative sampling based frequent itemset mining for big data

delete2015-03-20
delete20
PRE
AI
X
Xian Wu *
W
Wei Fan
J
Jing Peng
K
Kun Zhang
Y
Yong Yu
DOI:10.1007/s13042-015-0345-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Frequent pattern mining attracts extensive research interests over the past two decades: including mining frequent item sets from transactions, extracting frequent sequences from bio-arrays and detecting common subgraph from molecular structures. In the era of big data, the explosive data volume brings new challenges to frequent pattern mining: (1) Space complexity: both input data, intermediate results and the outputted patterns could be too large to fit into memory which prevents many algorithms from executing; (2) Time complexity: many existing approaches rely on exhaustive search or complicated data structures to mine frequent patterns which prove to be inapplicable for big data. To deal with these two challenges. we propose ISbFIM, an Iterative Sampling based Frequent Itemset Mining method. Rather than process the entire data set at once, ISbFIM samples computationally-manageable subsets and extracts frequent itemsets from these subsets. By repeating this process for a sufficient number of times, we can guarantee both theoretically and empirically that the frequent itemsets can be enumerated without running into a combinatorial explosion. ISbFIM can be easily parallelized and applied to mine item sets, sequences or structures. We implement a Map-Reduce version of ISbFIM to demonstrate its scalability on big data.
Keyword:
Frequent itemset mining
Big data
Iterative sampling
Parallelization
Map-reduce
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Machine Learning and Cybernetics 封面图
International Journal of Machine Learning and Cybernetics
IF:
2.7
论文数:
3.2K
被引数:
5.6K

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
X
Xavier University of Louisiana
学者数:
681
论文数: 489
被引数: 0
M
Montclair State University
学者数:
1.4K
论文数: 1.3K
被引数: 1.8K
B
baidu
学者数:
578
论文数: 471
被引数: 1
学者 查看更多机构
引用论文

引用论文

Indenyl and fluorenyl transition element complexes
err1978-10-01
err0
PREAI
errA.N. Nesmeyanov; N.A. Ustynyuk; L.G. Makarova; V.G. Andrianov; Yu.T. Struchkov; Steffen Andrae; Yu.A. Ustynyuk; S.G. Malyugina
err分享
err收藏
NF-κB p65 repression by the sesquiterpene lactone, Helenalin, contributes to the induction of autophagy cell death
err2012-07-11
err0
errOAAI
errChuan Bian Lim; Pan You Fu; Nung Ky; Hong Shuang Zhu; XiaoLing Feng; Jinming Li; Kandhadayar Gopalan Srinivasan; Mohamed Sabry Hamza; Yan Zhao
err分享
err收藏
Non-Puerperal Induced Lactation
err1972-07-01
err0
PREAI
errDerrick B. Jelliffe; E. F. Patrice Jelliffe
err分享
err收藏
Chlorpromazine and human sleep
err1971-01-01
err0
PREAI
errBoyd K. Lester; Joe D. Coulter; Lawrence C. Cowden; Harold L. Williams
err分享
err收藏
Modern Management of Testicular Cancer
err2018-09-01
err0
PREAI
errJian Chen; Siamak Daneshmand
err分享
err收藏
err分享
err收藏
The origin of squamates revealed by a Middle Triassic lizard from the Italian Alps
err2018-05-30
err0
PREAI
errTiago R. Simões; Michael W. Caldwell; Mateusz Tałanda; Massimo Bernardi; Alessandro Palci; Oksana Vernygora; Federico Bernardini; Lucia Mancini; Randall L. Nydam
err分享
err收藏
学者 查看更多内容