arrow
返回

Consistent Matrix: A Feature Selection Framework for Large-Scale Datasets

delete2023-11-01
delete5
PRE
AI
T
Tian Yang
Y
Y. Li
钱宇华 封面图
钱宇华 (Yuhua Qian)
F
Fei‐Yue Wang *
DOI:10.1109/TFUZZ.2023.3275635delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Large-scale data processing based on limited computing resources has always been a difficult problem in data mining, where feature selection is often used as an effective data compressing mechanism. For granular computing of Big Data, discernibility matrix and dependency degree are the most representative methods for matrix-based and feature-importance-degree-based feature selection, respectively. However, their temporal and space complexities are high and often lead to poor performance. In this article, a novel feature selection framework for large-scale data processing with linear complexities was proposed for the first time. First, a much more concise fuzzy granule set, called fuzzy arithmetic covering, was introduced to reduce computational costs. Then, a new matrix-based feature selection framework, namely consistent matrix, was proposed for general rough set models. As a result, a heuristic attribute reduction algorithm, i.e., HARCM, was designed accordingly. Compared with six state-of-the-art algorithms for feature selection, the average running time of the newly proposed algorithm was reduced up to 2913 times, with a comparable or even better classification performance.
Keyword:
Consistent matrix
feature selection
fuzzy arithmetic covering
fuzzy rough sets
granular computing

期刊

IEEE Transactions on Fuzzy Systems 封面图
IEEE Transactions on Fuzzy Systems
IF:
11.9
论文数:
5.0K
被引数:
2.9W

机构

H
Hunan Normal University
学者数:
1.3W
论文数: 8.2K
被引数: 9.1K
S
Shanxi University
学者数:
1.3W
论文数: 8.4K
被引数: 1.2W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Porous photocatalysts for advanced water purifications用于高级水净化的多孔光催化剂
err2010-01-01
err0
PREAI
errJia Hong Pan; Haiqing Dou; Zhigang Xiong; Chen Xu; Jizhen Ma; X. S. Zhao
err分享
err收藏
Granularity and Entropy of Intuitionistic Fuzzy Information and Their Applications
err2022-01-01
err53
PREAI
errTan, Anhui; Shi, Suwei; Wu, Wei-Zhi; Li, Jinjin; Pedrycz, Witold
err分享
err收藏
Recent Advances in Nanoparticle-Based Optical Sensors for Detection of Pesticide Residues in Soil
err2023-03-23
err0
errOAAI
errChunhong Zhang; Mingle Qiu; Jinglin Wang; Yongchun Liu
err分享
err收藏
学者 查看更多内容