arrow
返回

Distributed representation learning with skip-gram model for trained random forests

delete2023-09-01
delete2
PRE
AI
C
Chao Ma
T
Tianjun Wang
张乐 封面图
张乐 (Le Zhang)
Z
Zhiguang Cao
Y
Yue Huang
X
Xinghao Ding *
DOI:10.1016/j.neucom.2023.126434delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The random forest family has been extensively studied due to its wide applications in machine learning and data analytics. However, the representation abilities of forests have not been explored yet. The existing forest representation is mainly based on feature hashing on the indices of leaf nodes. Feature hashing typically disregards the information from tree structures, i.e., the relationships between leaf nodes. Furthermore, the visualisation abilities of feature hashing are limited. On the contrary, the Skip-Gram model has been widely explored in word and node embedding due to its excellent representation ability. This paper proposes distributed representation learning for trained forests (DRL-TF) to extract co-occurrence relationships of samples and tree structures, and further boost the representation abilities of the trained forest using the Skip-Gram model. The experimental results demonstrate that the proposed DRL-TF outperforms the challenging baselines. To the best of the authors' knowledge, the visualisation by DRL-TF is the first tool to analyse the trained forests. The code is available at: https://github.com/machao199271/ DRL-TF.
Keyword:
Distributed representation learning
random forest
co-occurrence relationship
Skip-Gram
feature hashing

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

S
Singapore Management University
学者数:
1.5K
论文数: 2.5K
被引数: 3.5K
X
xiamen university
学者数:
5.9W
论文数: 3.8W
被引数: 67
引用论文

引用论文

An improved deep forest for alleviating the data imbalance problem
err2020-08-28
err8
PREAI
errGao, Jie; Liu, Kunhong; Wang, Beizhan; Wang, Dong; Hong, Qingqi
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容