.png){kind=icon}
返回
Attention-based random forest and contamination model
.png){kind=icon}
OA
AI
DOI：10.1016/j.neunet.2022.07.029.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A new approach called ABRF (the attention-based random forest) and its modifications for applying the attention mechanism to the random forest (RF) for regression and classification are proposed. The main idea behind the proposed ABRF models is to assign attention weights with trainable parameters to decision trees in a specific way. The attention weights depend on the distance between an instance, which falls into a corresponding leaf of a tree, and training instances, which fall in the same leaf. This idea stems from representation of the Nadaraya-Watson kernel regression in the form of a RF. Three modifications of the general approach are proposed. The first one is based on applying the Huber's contamination model and on computing the attention weights by solving quadratic or linear optimization problems. The second and the third modifications use the gradient-based algorithms for computing an extended set of the attention trainable parameters. Numerical experiments with various regression and classification datasets illustrate the proposed method. The code implementing the approach is publicly available. (C) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Attention mechanism
Random forest
Nadaraya-Watson regression
Quadratic programming
Contamination model
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
Highly efficient electrocatalytic hydrogen production by nickel promoted molybdenum sulfide microspheres catalysts镍促进硫化钼微球催化剂的高效电催化制氢.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏分享收藏
查看更多内容