arrow
返回

Sparse Hierarchical Table Ensemble-A Deep Learning Alternative for Tabular Data

delete2022-01-01
delete0
delete
OA
AI
G
Guy Farjon *
A
Aharon Bar-Hillel
DOI:10.1109/ACCESS.2022.3190537delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning for tabular data is drawing increasing attention, with recent work attempting to boost the accuracy of neuron-based networks. However, such deep learning models are deserted when computational capacity is low, as in Internet of Things (IoT), drone, or Natural User Interface (NUI) applications. We offer to enable deep learning capabilities using ferns (oblivious decision trees) instead of neurons by constructing a Sparse Hierarchical Table Ensemble (S-HTE). S-HTE is dense at the beginning of the training process and becomes gradually sparse using an annealing mechanism, leading to an efficient final predictor. Unlike previous work with ferns, S-HTE learns useful internal representations and earns from increasing depth. Using a standard classification and regression benchmark, we show its accuracy is comparable to alternatives while havingy lower computational complexity. Our PyTorch implementation is available at https://github.com/farjon/HTE_CTE.
Keyword:
Computational modeling
Neurons
Deep learning
Decision trees
Computer architecture
Training
Task analysis
Deep learning
deep trees
DNN alternative
tabular data

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

B
ben-gurion university of the negev
学者数:
8.4K
论文数: 5.1K
被引数: 1
引用论文

引用论文

Deep forest
err2018-10-08
err509
errOAAI
errZhou, Zhi-Hua; Feng, Ji
err分享
err收藏
Dissection of the enzymatic and immunologic functions of macrophage migration inhibitory factor
err2001-12-25
err0
errOAAI
errRobert Kleemann; Hans Rorsman; Evald Rosengren; Ralf Mischke; Nguyen Tuyet Mai; Jürgen Bernhagen
err分享
err收藏
Efficient photo-Fenton activity in mesoporous MIL-100(Fe) decorated with ZnO nanosphere for pollutants degradation
err2019-05-01
err0
PREAI
errMunir Ahmad; Shuo Chen; Fei Ye; Xie Quan; Shahzad Afzal; Hongtao Yu; Xueyang Zhao
err分享
err收藏
学者 查看更多内容