arrow
返回

A Distributed Fuzzy Associative Classifier for Big Data

delete2018-09-01
delete36
delete
OA
AI
A
Armando Segatori
A
Alessio Bechini
P
Pietro Ducange
F
Francesco Marcelloni
DOI:10.1109/TCYB.2017.2748225delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Fuzzy associative classification has not been widely analyzed in the literature, although associative classifiers (ACs) have proved to be very effective in different real domain applications. The main reason is that learning fuzzy ACs is a very heavy task, especially when dealing with large datasets. To overcome this drawback, in this paper, we propose an efficient distributed fuzzy associative classification approach based on the MapReduce paradigm. The approach exploits a novel distributed discretizer based on fuzzy entropy for efficiently generating fuzzy partitions of the attributes. Then, a set of candidate fuzzy association rules is generated by employing a distributed fuzzy extension of the well-known FP-Growth algorithm. Finally, this set is pruned by using three purposely adapted types of pruning. We implemented our approach on the popular Hadoop framework. Hadoop allows distributing storage and processing of very large data sets on computer clusters built from commodity hardware. We have performed an extensive experimentation and a detailed analysis of the results using six very large datasets with up to 11 000 000 instances. We have also experimented different types of reasoning methods. Focusing on accuracy, model complexity, computation time, and scalability, we compare the results achieved by our approach with those obtained by two distributed nonfuzzy ACs recently proposed in the literature. We highlight that, although the accuracies result to be comparable, the complexity, evaluated in terms of number of rules, of the classifiers generated by the fuzzy distributed approach is lower than the one of the nonfuzzy classifiers.
Keyword:
Associative classifier (AC)
big data
fuzzy AC (FAC)
fuzzy FP-Growth
Hadoop
MapReduce
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

暂无机构信息
引用论文

引用论文

Gold Nanoparticles: Synthesis, Stability Test, and Application for the Rice Growth
err2014-09-02
err0
errOAAI
errAiwu Wang; Hoi Pong Ng; Yi Xu; Yuyu Li; Yuhong Zheng; Jingping Yu; Fugui Han; Feng Peng; Li Fu
err分享
err收藏
Avo-AirDB: An avocado UAV Database for agricultural image segmentation and classification
err2022-12-01
err0
errOAAI
errKhalid EL Amraoui; Mouataz Lghoul; Ayoub Ezzaki; Lhoussaine Masmoudi; Majid Hadri; Hicham Elbelrhiti; Aziz Abdou Simo
err分享
err收藏
Evaluation of Diverse Convolutional Neural Networks and Training Strategies for Wheat Leaf Disease Identification with Field-Acquired Photographs
err2022-07-18
err0
errOAAI
errJiale Jiang; Haiyan Liu; Chen Zhao; Can He; Jifeng Ma; Tao Cheng; Yan Zhu; Weixing Cao; Xia Yao
err分享
err收藏
Four Projection Streams from Primate V1 to the Cytochrome Oxidase Stripes of V2
err2009-12-09
err0
errOAAI
errFrederick Federer; Jennifer M. Ichida; Janelle Jeffs; Ingo Schiessl; Niall McLoughlin; Alessandra Angelucci
err分享
err收藏
Detection and Counting of Maize Leaves Based on Two-Stage Deep Learning with UAV-Based RGB Image
err2022-10-27
err0
errOAAI
errXingmei Xu; Lu Wang; Meiyan Shu; Xuewen Liang; Abu Zar Ghafoor; Yunling Liu; Yuntao Ma; Jinyu Zhu
err分享
err收藏
学者 查看更多内容