.png){kind=icon}
Return
A Novel Consistent Random Forest Framework: Bernoulli Random Forests
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2017.2729778.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Random forests (RFs) are recognized as one type of ensemble learning method and are effective for the most classification and regression tasks. Despite their impressive empirical performance, the theory of RFs has yet been fully proved. Several theoretically guaranteed RF variants have been presented, but their poor practical performance has been criticized. In this paper, a novel RF framework is proposed, named Bernoulli RFs (BRFs), with the aim of solving the RF dilemma between theoretical consistency and empirical performance. BRF uses two independent Bernoulli distributions to simplify the tree construction, in contrast to the RFs proposed by Breiman. The two Bernoulli distributions are separately used to control the splitting feature and splitting point selection processes of tree construction. Consequently, theoretical consistency is ensured in BRF, i.e., the convergence of learning performance to optimum will be guaranteed when infinite data are given. Importantly, our proposed BRF is consistent for both classification and regression. The best empirical performance is achieved by BRF when it is compared with state-of-the-art theoretical/consistent RFs. This advance in RF research toward closing the gap between theory and practice is verified by the theoretical and experimental studies in this paper.
Keywords:
Classification
consistency
random forests (RFs)
regression
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
8.9
Papers:
7.6K
Citations:
7.2W
Organization
Cited Papers
ShareSaveShareSaveNewer classification and regression tree techniques: Bagging and random forests for ecological prediction.png)
ECOSYSTEMS
ECOSYSTEMSIF3.3
PREAI
ShareSaveEbenensystem zur Resilienzbewertung kritischer Verkehrsinfrastrukturen am Beispiel der WasserstraßenBautechnik
BautechnikIF0
PREAI
ShareSaveHuman disturbance of Bewick's Swans is reflected in giving‐up net energy intake rate, but not in giving‐up food densityIbisOAAI
IbisIF0
OAAIShareSaveShareSave
View more