arrow
Return

A new tree-based approach to mine sequential patterns

delete2024-05-01
delete10
PRE
AI
R
Redwan Ahmed Rizvee
C
Chowdhury Farhan Ahmed *
M
Md. Fahim Arefin
C
Carson K. Leung
DOI:10.1016/j.eswa.2023.122754delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Generic sequential pattern mining problem aims to mine the set of sequential patterns from a sequential database that satisfies a minimum support or occurrence threshold constraint. The main challenges that affect the efficiency of a solution lie in reducing the pattern search space, early detecting the infrequent patterns, representing the database in an efficient format, etc. Also, additional challenges get included when the problem environment transitions from static to incremental database leading to not to re-mine but efficiently tracking the effect of the incremental portion over the complete updated database. In this article, we introduce a new tree-based solution to the sequential pattern mining problem, including two sets of novel solutions for static and incremental sequential databases. We propose two new structures, SP-Tree and IncSP-Tree, and design two efficient algorithms, Tree-Miner and IncTree-Miner to mine the complete set of sequential patterns from static and incremental databases respectively. The proposed novel structures provide an efficient manner to store the complete sequential database maintaining build-once-mine-many property and giving scope to perform interactive mining. Additionally, we also design a new breath-first based support counting technique to efficiently identify the infrequent patterns at early stages and a new heuristic pruning strategy to reduce pattern search space. We also design a new pattern storage structure BPFSP-Tree to store the frequent patterns during successive iterations in incremental mining to reduce the number of database scans and to remove the infrequent patterns efficiently. A novel structure named Sequence Summarizer is also introduced to efficiently calculate and update the co-occurrence information of the items, especially in an incremental environment. Experimental results from various real-life and synthetic datasets demonstrate the efficiency of our work in comparison with the related state-of-the-art approaches.
Keywords:
Sequential pattern
Tree-based mining
Incremental mining
Breadth-first based pruning
Pattern storage

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

U
University of Manitoba
Scholars:
1.9W
Papers: 1.7W
Citations: 18
U
University of Dhaka
Scholars:
4.1K
Papers: 2.7K
Citations: 3.8K