arrow
Return

Hierarchical attribute reduction algorithms for big data using MapReduce

delete2015-01-01
delete109
PRE
AI
J
Jin Qian *
吕
吕萍 (Ping Lv)
X
Xiaodong Yue
C
Caihui Liu
Z
Zhengjun Jing
DOI:10.1016/j.knosys.2014.09.001delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Attribute reduction is one of the important research issues in rough set theory. Most existing attribute reduction algorithms are now faced with two challenging problems. On one hand, they have seldom taken granular computing into consideration. On the other hand, they still cannot deal with big data. To address these issues, the hierarchical encoded decision table is first defined. The relationships of hierarchical decision tables are then discussed under different levels of granularity. The parallel computations of the equivalence classes and the attribute significance are further designed for attribute reduction. Finally, hierarchical attribute reduction algorithms are proposed in data and task parallel using MapReduce. Experimental results demonstrate that the proposed algorithms can scale well and efficiently process big data. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Hierarchical attribute reduction
Granular computing
Data and task parallelism
MapReduce
Big data
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

J
Jiangsu University of Technology
Scholars:
2.6K
Papers: 1.8K
Citations: 2.0K
G
Gannan Normal University
Scholars:
2.6K
Papers: 1.4K
Citations: 2.1K
S
shanghai university
Scholars:
3.9W
Papers: 2.7W
Citations: 52
researcher View more organizations
Cited Papers

Cited Papers

Single strain control of microbial consortia
err
IF0
err2019-12-25
err0
errOAAI
errAlex J.H. Fedorec; Behzad D. Karkaria; Michael Sulu; Chris P Barnes
errShare
errSave
Author response: Method for identification of condition-associated public antigen receptor sequences
err
IF0
err2018-01-27
err0
errOAAI
errMikhail V Pogorelyy; Anastasia A Minervina; Dmitriy M Chudakov; Ilgar Z Mamedov; Yuri B Lebedev; Thierry Mora; Aleksandra M Walczak
errShare
errSave
Porous photocatalysts for advanced water purifications
err2010-01-01
err0
PREAI
errJia Hong Pan; Haiqing Dou; Zhigang Xiong; Chen Xu; Jizhen Ma; X. S. Zhao
errShare
errSave
Data and task parallelism in ILP using MapReduce
err2011-05-10
err47
errOAAI
errSrinivasan, Ashwin; Faruquie, Tanveer A.; Joshi, Sachindra
errShare
errSave
errShare
errSave
Learning cross-level certain and possible rules by rough sets
err2008-04-01
err38
PREAI
errHong, Tzung-Pei; Lin, Chun-E; Lin, Jiann-Horng; Wang, Shyue-Liang
errShare
errSave
researcher View more