arrow
Return

Consistent Matrix: A Feature Selection Framework for Large-Scale Datasets

delete2023-11-01
delete5
PRE
AI
T
Tian Yang
Y
Y. Li
钱宇华 cover
钱宇华 (Yuhua Qian)
F
Fei‐Yue Wang *
DOI:10.1109/TFUZZ.2023.3275635delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Large-scale data processing based on limited computing resources has always been a difficult problem in data mining, where feature selection is often used as an effective data compressing mechanism. For granular computing of Big Data, discernibility matrix and dependency degree are the most representative methods for matrix-based and feature-importance-degree-based feature selection, respectively. However, their temporal and space complexities are high and often lead to poor performance. In this article, a novel feature selection framework for large-scale data processing with linear complexities was proposed for the first time. First, a much more concise fuzzy granule set, called fuzzy arithmetic covering, was introduced to reduce computational costs. Then, a new matrix-based feature selection framework, namely consistent matrix, was proposed for general rough set models. As a result, a heuristic attribute reduction algorithm, i.e., HARCM, was designed accordingly. Compared with six state-of-the-art algorithms for feature selection, the average running time of the newly proposed algorithm was reduced up to 2913 times, with a comparable or even better classification performance.
Keywords:
Consistent matrix
feature selection
fuzzy arithmetic covering
fuzzy rough sets
granular computing

Journal

IEEE Transactions on Fuzzy Systems cover
IEEE Transactions on Fuzzy Systems
IF:
11.9
Papers:
5.0K
Citations:
2.9W

Organization

H
Hunan Normal University
Scholars:
1.3W
Papers: 8.2K
Citations: 9.1K
S
Shanxi University
Scholars:
1.3W
Papers: 8.4K
Citations: 1.2W
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

GBNRS: A Novel Rough Set Algorithm for Fast Adaptive Attribute Reduction in Classification
err2022-03-01
err119
PREAI
errXia, Shuyin; Zhang, Hao; Li, Wenhua; Wang, Guoyin; Giem, Elisabeth; Chen, Zizhong
errShare
errSave
Porous photocatalysts for advanced water purifications
err2010-01-01
err0
PREAI
errJia Hong Pan; Haiqing Dou; Zhigang Xiong; Chen Xu; Jizhen Ma; X. S. Zhao
errShare
errSave
Granularity and Entropy of Intuitionistic Fuzzy Information and Their Applications
err2022-01-01
err53
PREAI
errTan, Anhui; Shi, Suwei; Wu, Wei-Zhi; Li, Jinjin; Pedrycz, Witold
errShare
errSave
Feature Selection With Fuzzy-Rough Minimum Classification Error Criterion
err2022-08-01
err75
PREAI
errWang, Changzhong; Qian, Yuhua; Ding, Weiping; Fan, Xiaodong
errShare
errSave
Recent Advances in Nanoparticle-Based Optical Sensors for Detection of Pesticide Residues in Soil
err2023-03-23
err0
errOAAI
errChunhong Zhang; Mingle Qiu; Jinglin Wang; Yongchun Liu
errShare
errSave
researcher View more