arrow
返回

An Efficient Parallel Mining Algorithm Representative Pattern Set of Large-Scale Itemsets in IoT

delete2018-01-01
delete5
delete
OA
AI
T
Tianrui Zhang *
M
Mingqi Wei
B
Bin Liu
DOI:10.1109/ACCESS.2018.2884888delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
With the advent of the age of big data, people can collect rich and diverse data from a wide variety of collection devices, such as those of the Internet of Things. Knowledge hidden in large data is very useful and valuable. Frequent pattern mining, as a basic method of data mining, is applied to every aspect of society. However, the application of traditional frequent pattern mining methods to big data involves bottlenecks due to the large number of result sets. Such bottlenecks make it difficult to produce practical value in production and life. Therefore, mining representative pattern sets has been proposed. However, most existing algorithms select representative patterns after mining frequent pattern sets. This framework can make the runtime difficult to evaluate in large data environments. To solve the above-mentioned problems, this paper presents an online representative pattern-set parallel-mining algorithm. Within the parallel MapReduce framework, this algorithm uses horizontal segmentation to process the database and then applies the online mining algorithm to mine the locally represented pattern sets on each small database. Finally, several performance optimization strategies are proposed. As shown by numerous experiments on the actual dataset, the algorithm proposed in this paper improves the time efficiency by one order of magnitude. Several optimization strategies reduce the execution time to varying degrees.
Keyword:
Big data
IoT data analysis
MapReduce
online parallel mining
representative pattern
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

S
Shenyang University
学者数:
1.3K
论文数: 744
被引数: 918
引用论文

引用论文

Surrogate decision-making in Korean patients with advanced cancer: a longitudinal study
err2012-05-31
err0
PREAI
errJune Koo Lee; Bhumsuk Keam; Ah Reum An; Tae Min Kim; Se-Hoon Lee; Dong-Wan Kim; Dae Seog Heo
err分享
err收藏
Efficient Algorithms for Mining Top-K High Utility Itemsets
err2016-01-01
err167
PREAI
errTseng, Vincent S.; Wu, Cheng-Wei; Fournier-Viger, Philippe; Yu, Philip S.
err分享
err收藏
One stage procedure in the management of acute sigmoid volvulus without colonic lavage
err2007-10-01
err0
PREAI
errA.Z. Sule; M. Misauno; A.S. Opaluwa; E. Ojo; P.O. Obekpa
err分享
err收藏
err分享
err收藏
A Method for Detecting Outliers from the Gamma Distribution
err2023-01-19
err0
errOAAI
errXiou Liao; Tongtong Wang; Guohua Zou
err分享
err收藏
err分享
err收藏
学者 查看更多内容