返回
A Distributed Fuzzy Associative Classifier for Big Data
DOI:10.1109/TCYB.2017.2748225.png)
摘要
En 中文
Fuzzy associative classification has not been widely analyzed in the literature, although associative classifiers (ACs) have proved to be very effective in different real domain applications. The main reason is that learning fuzzy ACs is a very heavy task, especially when dealing with large datasets. To overcome this drawback, in this paper, we propose an efficient distributed fuzzy associative classification approach based on the MapReduce paradigm. The approach exploits a novel distributed discretizer based on fuzzy entropy for efficiently generating fuzzy partitions of the attributes. Then, a set of candidate fuzzy association rules is generated by employing a distributed fuzzy extension of the well-known FP-Growth algorithm. Finally, this set is pruned by using three purposely adapted types of pruning. We implemented our approach on the popular Hadoop framework. Hadoop allows distributing storage and processing of very large data sets on computer clusters built from commodity hardware. We have performed an extensive experimentation and a detailed analysis of the results using six very large datasets with up to 11 000 000 instances. We have also experimented different types of reasoning methods. Focusing on accuracy, model complexity, computation time, and scalability, we compare the results achieved by our approach with those obtained by two distributed nonfuzzy ACs recently proposed in the literature. We highlight that, although the accuracies result to be comparable, the complexity, evaluated in terms of number of rules, of the classifiers generated by the fuzzy distributed approach is lower than the one of the nonfuzzy classifiers.
Keyword:
Associative classifier (AC)
big data
fuzzy AC (FAC)
fuzzy FP-Growth
Hadoop
MapReduce
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
暂无机构信息
引用论文
A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning基于遗传规则选择和横向调整的高维问题模糊关联规则分类模型
A novel associative classification model based on a fuzzy frequent pattern mining algorithm基于模糊频繁模式挖掘算法的关联分类模型
Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced big dataMapReduce框架下基于代价敏感语言模糊规则的不平衡大数据分类系统

