.png){kind=icon}
返回
Pheromone-guided parallel rough hypercuboid attribute reduction algorithm
.png){kind=icon}
PRE
AI
DOI：10.1016/j.asoc.2024.111479.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In knowledge discovery and data mining, removing redundant and irrelevant data attributes is crucial. Traditional algorithms, however, struggle with efficiency in high -dimensional big data contexts. To solve this problem, this paper proposes a novel global search attribute reduction method namely RHC-IGWO (Rough Hypercuboid Structure via Improved Grey Wolf Optimizer) by integrating the rough hypercuboid method and Improved Grey Wolf Optimizer (IGWO) with the pheromone mechanism. The algorithm is embedded into the Apache Spark parallel computing framework (Parallel computing Rough Hypercuboid Structure via Improved Grey Wolf Optimizer, PcRHC-IGWO) to accelerate and simplify the attribute reduction process. The algorithm divides the decision table into several independent blocks, introduces the pheromone mechanism to simulate the wolf pack behavior, and uses the IGWO for global search, which is conducive to efficient local search and global information sharing between individuals. The position of the individual is initialized by calculating the relevance between the attributes, and the pheromone value is dynamically updated according to the reduction quality. This allows automatically giving more search focus to more promising attribute regions. Experiments with public and real datasets demonstrate the RHC-IGWO algorithm ' s significant speedup and its efficacy in maintaining or enhancing classification accuracy. Particularly noteworthy is its performance on schizophrenia datasets, where the proposed method achieves outstanding classification accuracies of 86.2%, 88.89%, and 92.86% across various classifiers. These results not only demonstrate its effectiveness but also underline its potential in advanced data analysis scenarios. Additionally, on some large-scale datasets, the time required for processing has been reduced by 85.71%, showcasing the algorithm ' s efficiency in handling complex and voluminous data.
Keyword:
Attribute reduction
Rough hypercuboid approach
Grey Wolf Optimizer
Parallel computing
Spark framework
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
A new method for feature selection based on weighted k-nearest neighborhood rough set基于加权k近邻粗糙集的特征选择新方法
PREAI
分享收藏分享收藏Two stage forecast engine with feature selection technique and improved meta-heuristic algorithm for electricity load forecasting具有特征选择技术和改进元启发式算法的两阶段预测引擎，用于电力负荷预测.png)
ENERGY
ENERGYIF9.4
PREAI
分享收藏Correlation-Guided Updating Strategy for Feature Selection in Classification With Surrogate-Assisted Particle Swarm Optimization代理辅助粒子群优化分类中特征选择的相关性引导更新策略
PREAI
分享收藏A Brain-Wide Association Study of DISC1 Genetic Variants Reveals a Relationship With the Structure and Functional Connectivity of the Precuneus in SchizophreniaHUMAN BRAIN MAPPING
OAAI
HUMAN BRAIN MAPPINGIF3.3
OAAI分享收藏Left orbitofrontal and superior temporal gyrus structural changes associated to suicidal behavior in patients with schizophrenia精神分裂症患者左眶额和颞上回结构改变与自杀行为相关
PREAI
分享收藏
查看更多内容