arrow
返回

Computing Hierarchical Summary from Two-Dimensional Big Data Streams

delete2018-04-01
delete8
PRE
AI
Z
Zubair Shah *
A
Abdun Naser Mahmood
M
Michael Barlow
Z
Zahir Tari
X
Xun Yi
A
Albert Y. Zomaya
DOI:10.1109/TPDS.2017.2778734delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
There are many application domains, where hierarchical data is inherent, but surprisingly, there are few techniques for mining patterns from such important data. Hierarchical Heavy Hitters (HHH) and multilevel and Cross-Level Association Rules (CLAR) mining are well-known hierarchical pattern mining techniques. The problem in these techniques; however, is that they focus on capturing only global patterns from data but cannot identify local contextual patterns. Another problem in these techniques is that they treat all data items in the transaction equally and do not consider the sequential nature of the relationship among items within a transaction; hence, they cannot capture the correlation semantic within the transactions of the data items. There are many applications such as clickstream mining, healthcare data mining, network monitoring, and recommender systems, which require to identify local contextual patterns and correlation semantics. In this work, we introduce a new concept, which can capture the sequential nature of the relationship between pairs of hierarchical items at multiple concept levels and can capture local contextual patterns within the context of the global patterns. We call this notion Hierarchically Correlated Heavy Hitters (HCHH). Specifically, the proposed approach finds the correlation between items corresponding to hierarchically discounted frequency counts. We have provided formal definitions of the proposed concept and developed algorithmic approaches for computing HCHH in data streams efficiently. The proposed HCHH algorithm have deterministic error guarantees, and space bounds. It requires O (eta/epsilon(p)epsilon(s)) sthorn memory, where eta is a small constant, and epsilon(p) is an element of [0,1], epsilon(s) is an element of [0,1] are user defined parameters on upper bounds of estimation error. We have compared the proposed HCHH concept with existing hierarchical pattern mining approaches both theoretically as well as experimentally.
Keyword:
Hierarchical patterns
association rules
frequent patterns
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
M
Macquarie University
学者数:
1.2W
论文数: 1.5W
被引数: 2.2W
L
La Trobe University
学者数:
1.1W
论文数: 1.1W
被引数: 1.5W
学者 查看更多机构
引用论文

引用论文

Feasibility of diffusion tensor tractography for preoperative prediction of the location of the facial and vestibulocochlear nerves in relation to vestibular schwannoma
err2015-04-12
err0
PREAI
errMasanori Yoshino; Taichi Kin; Akihiro Ito; Toki Saito; Daichi Nakagawa; Kenji Ino; Kyousuke Kamada; Harushi Mori; Akira Kunimatsu; Hirofumi Nakatomi; Hiroshi Oyama; Nobuhito Saito
err分享
err收藏
A Fully Integrated 32 Gbps 2x2 LoS MIMO Wireless Link with UWB Analog Processing for Point-to-Point Backhaul Applications
err2020-08-01
err0
PREAI
errMahmoud Sawaby; Baptiste Grave; Clement Jany; Cheng Chen; Siavash Kananian; Pierino Calascibetta; Frederic Gianesello; Amin Arbabian
err分享
err收藏
err分享
err收藏
学者 查看更多内容