arrow
Return

New margin-based subsampling iterative technique in modified random forests for classification

delete2019-10-01
delete47
PRE
AI
W
Wei Feng *
G
Gabriel Dauphin
W
Wenjiang Huang
Y
Yinghui Quan
W
Wenzhi Liao
DOI:10.1016/j.knosys.2019.07.016delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diversity within base classifiers has been recognized as an important characteristic of an ensemble classifier. Data and feature sampling are two popular methods of increasing such diversity. This is exemplified by Random Forests (RFs), known as a very effective classifier. However real-world data remain challenging due to several issues, such as multi-class imbalance, data redundancy, and class noise. Ensemble margin theory is a proven effective way to improve the performance of classification models. It can be used to detect the most important instances and thus help ensemble classifiers to avoid the negative effects of the class noise and class imbalance. To obtain accurate classification results, this paper proposes the Ensemble-Margin Based Random Forests (EMRFs) method, which combines RFs and a new subsampling iterative technique making use of computed ensemble margin values. As for comparative analysis, the learning techniques considered are: SVM, AdaBoost, RFs and the Subsample based Random Forests (SubRFs). The SubRFs uses Out-Of-Bag (OOB) estimation to optimize the training size. The effectiveness of EMRFs is demonstrated on both balanced and imbalanced datasets. (C) 2019 Elsevier B.V. All rights reserved.
Keywords:
Classification
Ensemble margin
Diversity
Random forests
Sub-sampling
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

T
the institute of remote sensing & digital earth, cas
Scholars:
640
Papers: 581
Citations: 1
U
Universite Paris 13
Scholars:
2.9K
Papers: 2.0K
Citations: 4
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
C
chinese academy of sciences
Scholars:
56.4W
Papers: 44.9W
Citations: 704
researcher View more organizations