arrow
返回

Distributed Feature Selection for Big Data Using Fuzzy Rough Sets

delete2020-05-01
delete30
delete
OA
AI
L
Linghe Kong *
W
Wenhao Qu
俞
俞嘉地 (Jiadi Yu)
H
Hua Zuo
G
Guihai Chen
熊
熊菲 (Fei Xiong) *
Shirui Pan 封面图
Shirui Pan (Shirui Pan)
林
林思雨 (Siyu Lin)
M
Meikang Qiu
DOI:10.1109/TFUZZ.2019.2955894delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Fuzzy rough-set-based feature selection is an important technique for big data analysis. However, the classic fuzzy rough set algorithm takes all the data correlations into account, which leads to the centralized computing mode, requiring high computing and memory space resources. With the increasing amount of data in the big data era, the centralized server cannot afford the computation of fuzzy rough set. To enable the fuzzy rough set for big data analysis, in this article, we propose the novel distributed fuzzy rough set (DFRS)-based feature selection, which separates and assigns the tasks to multiple nodes for parallel computing. The key challenge is to maintain the global information on each distributed node without conserving the entire fuzzy relation matrix. We tackle this challenge by a dynamic data decomposition algorithm and a data summarization process on each distributed node. Extensive experiments based on multiple real datasets demonstrate that DFRS significantly improves the runtime, and its feature selection accuracy is nearly the same as the traditional centralized computing.
Keyword:
Rough sets
Feature extraction
Big Data
Servers
Distributed databases
Cloud computing
Heuristic algorithms
Big data
distributed feature selection
dynamic data decomposition
fuzzy rough sets
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Fuzzy Systems 封面图
IEEE Transactions on Fuzzy Systems
IF:
11.9
论文数:
5.0K
被引数:
2.9W

机构

M
Monash University
学者数:
5.4W
论文数: 5.4W
被引数: 79
B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
T
Texas A&M University System
学者数:
4.4W
论文数: 4.0W
被引数: 4.0K
学者 查看更多机构
引用论文

引用论文

Attributes Reduction Using Fuzzy Rough Sets基于模糊粗糙集的属性约简
err2008-10-01
err272
PREAI
errTsang, Eric C. C.; Chen, Degang; Yeung, Daniel S.; Wang, Xi-Zhao; Lee, John W. T.
err分享
err收藏
err分享
err收藏
Porous photocatalysts for advanced water purifications用于高级水净化的多孔光催化剂
err2010-01-01
err0
PREAI
errJia Hong Pan; Haiqing Dou; Zhigang Xiong; Chen Xu; Jizhen Ma; X. S. Zhao
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容