.png){kind=icon}
返回
OligoIS: Scalable Instance Selection for Class-Imbalanced Data Sets
.png){kind=icon}
PRE
AI
DOI：10.1109/TSMCB.2012.2206381.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In current research, an enormous amount of information is constantly being produced, which poses a challenge for data mining algorithms. Many of the problems in extremely active research areas, such as bioinformatics, security and intrusion detection, or text mining, share the following two features: large data sets and class-imbalanced distribution of samples. Although many methods have been proposed for dealing with class-imbalanced data sets, most of these methods are not scalable to the very large data sets common to those research fields. In this paper, we propose a new approach to dealing with the class-imbalance problem that is scalable to data sets with many millions of instances and hundreds of features. This proposal is based on the divide-and-conquer principle combined with application of the selection process to balanced subsets of the whole data set. This divide-and-conquer principle allows the execution of the algorithm in linear time. Furthermore, the proposed method is easy to implement using a parallel environment and can work without loading the whole data set into memory. Using 40 class-imbalanced medium-sized data sets, we will demonstrate our method's ability to improve the results of state-of-the-art instance selection methods for class-imbalanced data sets. Using three very large data sets, we will show the scalability of our proposal to millions of instances and hundreds of features.
Keyword:
Class-imbalance problem
instance selection
instance-based learning
very large problems
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Evolutionary-based selection of generalized instances for imbalanced classification基于进化的不平衡分类广义实例选择
PREAI
分享收藏
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏Synthesis, biologic and toxic effects of the major 2,3,7,8-tetrachlorodibenzo-p-dioxin metabolites in the ratToxicology
ToxicologyIF0
PREAI
分享收藏Using evolutionary algorithms as instance selection for data reduction in KDD: An experimental study使用进化算法作为KDD中数据约简的实例选择: 一项实验研究
PREAI
分享收藏分享收藏
查看更多内容