arrow
返回

A novel filter feature selection algorithm based on relief

delete2021-08-03
delete41
PRE
AI
X
Xueting Cui
李莹 封面图
李莹 (Ying Li)
J
Jiahao Fan *
T
Tan Wang
DOI:10.1007/s10489-021-02659-xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The Relief algorithm is a feature selection algorithm that uses the nearest neighbor to weight attributes. However, Relief only considers the correlation between features, which leads to a low classification accuracy on noisy datasets whose interaction effect is weak. To overcome the weaknesses of Relief, a novel feature selection algorithm, named Multidirectional Relief (MRelief), is proposed. The MRelief algorithm includes four improvements. First, the multidirectional neighbor search method, which finds all neighbors within a distance threshold from different orientations, is included to obtain regularly distributed neighbors. Therefore, the weights provided by MRelief are more accurate than those provided by Relief. Second, a novel objective function that incorporates the instances' force coefficients is introduced to reduce the influence of noise. Thus, the new objective function improves the classification accuracy of MRelief. Third, subset generation is introduced to the MRelief algorithm and combined with the maximum Pearson maximum distance (MPMD) to generate a promising candidate subset for feature selection. Finally, a novel multiclass margin definition is proposed and introduced to the MRelief algorithm to handle multiclass data. As demonstrated by extensive experiments on eleven UCI datasets and eleven real-world gene expression benchmarking datasets, MRelief is significantly better than other algorithms including LPLIR, ReliefF, LLH-Relief, MultiSURF, MSLIR-NN, MRMR, MPMD and STIR in our study.
Keyword:
Relief
ReliefF
Neighbor search
Feature selection
Classification

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
引用论文

引用论文

Usnic acid, a lichen secondary metabolite inhibits Group A Streptococcus biofilms
err2014-11-04
err0
PREAI
errParamasivam Nithyanand; Raja Mohmed Beema Shafreen; Subramanian Muthamil; Shunmugiah Karutha Pandian
err分享
err收藏
Binary dragonfly optimization for feature selection using time-varying transfer functions使用时变传递函数进行特征选择的二进制蜻蜓优化
err2018-12-01
err302
errOAAI
errMafarja, Majdi; Aljarah, Ibrahim; Heidari, Ali Asghar; Faris, Hossam; Fournier-Viger, Philippe; Li, Xiaodong; Mirjalili, Seyedali
err分享
err收藏
GMDH-based semi-supervised feature selection for customer classification
err2017-09-01
err49
PREAI
errXiao, Jin; Cao, Hanwen; Jiang, Xiaoyi; Gu, Xin; Xie, Ling
err分享
err收藏
Enhanced Thermochemical Energy Storage Stability of CaO-Based Composite Pellets Incorporated with a Zr-Based Stabilizer
err2021-11-02
err0
PREAI
errYue Zhou; Zijian Zhou; Lei Liu; Xiangyao She; Ruichang Xu; Jian Sun; Minghou Xu
err分享
err收藏
Feature selection considering weighted relevancy
err2018-07-13
err22
PREAI
errZhang, Ping; Gao, Wanfu; Liu, Guixia
err分享
err收藏
Spatially Uniform ReliefF (SURF) for computationally-efficient filtering of gene-gene interactions
err2009-09-22
err135
errOAAI
errGreene, Casey S.; Penrod, Nadia M.; Kiralis, Jeff; Moore, Jason H.
err分享
err收藏
Rapid building detection using machine learning
err2016-03-19
err33
PREAI
errCohen, Joseph Paul; Ding, Wei; Kuhlman, Caitlin; Chen, Aijun; Di, Liping
err分享
err收藏
学者 查看更多内容