.png){kind=icon}
返回
A Dynamic Spark-based Classification Framework for Imbalanced Big Data
.png){kind=icon}
PRE
AI
DOI：10.1007/s10723-018-9465-z.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Classification of imbalanced big data has assembled an extensive consideration by many researchers during the last decade. Standard classification methods poorly diagnosis the minority class samples. Several approaches have been introduced for solving the problem of class imbalance in big data to enhance the generalization in classification. However, most of these approaches neglect the effect of border samples on classification performance; the high impact border samples might expose to misclassification. In this paper, a Spark Based Mining Framework (SBMF) is proposed to address the imbalanced data problem. Two main modules are designed for this purpose. The first is the Border Handling Module (BHM) which under samples the low impact majority border instances and oversamples the minority class instances. The second module is the Selective Border Instances sampling (SBI) Module, which enhances the output of the BHM module. The performance of the SBMF framework is evaluated and compared with other recent systems. A number of experiments were performed using moderate and big datasets with different imbalanced ratio. The results obtained from SBMF framework, when compared to the recent works, show better performance for the different datasets and classifiers.
Keyword:
Big data
Classification
Spark
Sampling methods
Borders
Imbalanced datasets
SMOTE
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.9
论文数:
761
被引数:
1.2K
机构
引用论文
The effect of imbalanced data sets on LDA: A theoretical and empirical analysis.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Significant Rewiring of the Transcriptome and Proteome of an Escherichia coli Strain Harboring a Tailored Exogenous Global Regulator IrrEPLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Neuronal-binding antibodies from patients with antiphospholipid syndrome induce cognitive deficits following intrathecal passive transferLupus
LupusIF0
PREAI
分享收藏分享收藏Anomaly-based network intrusion detection: Techniques, systems and challengesCOMPUTERS & SECURITY
COMPUTERS & SECURITYIF5.4
PREAI
分享收藏
查看更多内容