.png){kind=icon}
Return
Distributed representation learning with skip-gram model for trained random forests
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.126434.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The random forest family has been extensively studied due to its wide applications in machine learning and data analytics. However, the representation abilities of forests have not been explored yet. The existing forest representation is mainly based on feature hashing on the indices of leaf nodes. Feature hashing typically disregards the information from tree structures, i.e., the relationships between leaf nodes. Furthermore, the visualisation abilities of feature hashing are limited. On the contrary, the Skip-Gram model has been widely explored in word and node embedding due to its excellent representation ability. This paper proposes distributed representation learning for trained forests (DRL-TF) to extract co-occurrence relationships of samples and tree structures, and further boost the representation abilities of the trained forest using the Skip-Gram model. The experimental results demonstrate that the proposed DRL-TF outperforms the challenging baselines. To the best of the authors' knowledge, the visualisation by DRL-TF is the first tool to analyse the trained forests. The code is available at: https://github.com/machao199271/ DRL-TF.
Keywords:
Distributed representation learning
random forest
co-occurrence relationship
Skip-Gram
feature hashing
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W
Organization
Cited Papers
Dual coordinate descent methods for logistic regression and maximum entropy models.png)
MACHINE LEARNING
OAAI
MACHINE LEARNINGIF2.9
OAAIShareSaveThe SO2 camera: A simple, fast and cheap method for ground‐based imaging of SO2 in volcanic plumes
OAAI
OAAIShareSaveHighly efficient electrocatalytic hydrogen production by nickel promoted molybdenum sulfide microspheres catalystsRSC Advances
RSC AdvancesIF0
PREAI
ShareSaveShareSave
View more