arrow
Return

A new algorithm for fast mining frequent itemsets using N-lists

delete2012-07-19
delete123
PRE
AI
邓志鸿 cover
邓志鸿 (Zhi‐Hong Deng) *
DOI:10.1007/s11432-012-4638-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Mining frequent itemsets has emerged as a fundamental problem in data mining and plays an essential role in many important data mining tasks. In this paper, we propose a novel vertical data representation called N-list, which originates from an FP-tree-like coding prefix tree called PPC-tree that stores crucial information about frequent itemsets. Based on the N-list data structure, we develop an efficient mining algorithm, PrePost, for mining all frequent itemsets. Efficiency of PrePost is achieved by the following three reasons. First, N-list is compact since transactions with common prefixes share the same nodes of the PPC-tree. Second, the counting of itemsets' supports is transformed into the intersection of N-lists and the complexity of intersecting two N-lists can be reduced to O(m + n) by an efficient strategy, where m and n are the cardinalities of the two N-lists respectively. Third, PrePost can directly find frequent itemsets without generating candidate itemsets in some cases by making use of the single path property of N-list. We have experimentally evaluated PrePost against four state-of-the-art algorithms for mining frequent itemsets on a variety of real and synthetic datasets. The experimental results show that the PrePost algorithm is the fastest in most cases. Even though the algorithm consumes more memory when the datasets are sparse, it is still the fastest one.
Keywords:
data mining
frequent itemset mining
data structure
N-lists
algorithm
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Science China Information Sciences cover
Science China Information Sciences
IF:
7.6
Papers:
4.9K
Citations:
8.9K

Organization

P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Indenyl and fluorenyl transition element complexes
err1978-10-01
err0
PREAI
errA.N. Nesmeyanov; N.A. Ustynyuk; L.G. Makarova; V.G. Andrianov; Yu.T. Struchkov; Steffen Andrae; Yu.A. Ustynyuk; S.G. Malyugina
errShare
errSave
errShare
errSave
Barriers and Facilitators of Use of Hydroxyurea among Children with Sickle Cell Disease: Experiences of Stakeholders in Tanzania
err2021-11-28
err0
errOAAI
errManase Kilonzi; Hamu J. Mlyuka; Fatuma Felix Felician; Dorkasi L. Mwakawanga; Lulu Chirande; David T. Myemba; Godfrey Sambayi; Ritah F. Mutagonda; Wigilya P. Mikomangwa; Joyce Ndunguru; Agnes Jonathan; Paschal Ruggajo; Irene Kida Minja; Emmanuel Balandya; Julie Makani; Nathanael Sirili
errShare
errSave
Special issue: Trichoderma – from Basic Biology to Biotechnology
err2012-01-01
err0
errOAAI
errGary E. Harman; Alfredo H. Herrera-Estrella; Benjamin A. Horwitz; Matteo Lorito
errShare
errSave
STUDY ON THE CRITERION OF SLIP-RESISTANCE FOR PEDESTRIAN ROAD PAVEMENT
err1996-11-20
err0
errOAAI
errKazuo Yada; Tetsuo Murai; Yasuhiro Tatema; Masaru Yamada
errShare
errSave
researcher View more