arrow
返回

TLTD: Transfer Learning for Tabular Data

delete2023-11-01
delete5
PRE
AI
M
Maxim Bragilovski
L
Lior Rokach *
S
Shelly Levy‐Tzedek *
DOI:10.1016/j.asoc.2023.110748delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep Neural Networks (DNNs) have become effective for various machine learning tasks. DNNs are known to achieve high accuracy with unstructured data in which each data sample (e.g., image) consists of many raw features (e.g., pixels) of the same type. The effectiveness of this approach diminishes for structured (tabular) data. In most cases, decision tree-based models such as Random Forest (RF) or Gradient Boosting Decision Trees (GBDT) outperform DNNs. In addition, DNNs tend to perform poorly when the number of samples in the dataset is small. This paper introduces Transfer Learning for Tabular Data (TLTD) which utilizes a novel learning architecture designed to extract new features from structured datasets. Using the DNN's learning capabilities on images, we convert the tabular data into images, then use the distillation technique to achieve better learning. We evaluated our approach with 25 structured datasets, and compared the outcomes to those of RF, eXtreme Gradient Boosting (XGBoost), Tabnet, KNN, and TabPFN. The results demonstrate the usefulness of the TLTD approach.& COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Deep-learning
Feature-extraction
Tabular datasets

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

B
ben gurion university
学者数:
1.3W
论文数: 1.0W
被引数: 5
引用论文

引用论文

Knowledge Distillation: A Survey知识蒸馏: 一项调查
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
err分享
err收藏
Transfer learning in computer vision tasks: Remember where you come from
err2020-01-01
err56
errOAAI
errLi, Xuhong; Grandvalet, Yves; Davoine, Franck; Cheng, Jingchun; Cui, Yin; Zhang, Hang; Belongie, Serge; Tsai, Yi-Hsuan; Yang, Ming-Hsuan
err分享
err收藏
Converting tabular data into images for deep learning with convolutional neural networks
err2021-05-31
err132
errOAAI
errZhu, Yitan; Brettin, Thomas; Xia, Fangfang; Partin, Alexander; Shukla, Maulik; Yoo, Hyunseung; Evrard, Yvonne A.; Doroshow, James H.; Stevens, Rick L.
err分享
err收藏
A survey of transfer learning迁移学习研究综述
err2016-05-28
err0
errOAAI
errKarl Weiss; Taghi M. Khoshgoftaar; DingDing Wang
err分享
err收藏
Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection
err2017-12-01
err682
errOAAI
errGopalakrishnan, Kasthurirangan; Khaitan, Siddhartha K.; Choudhary, Alok; Agrawal, Ankit
err分享
err收藏
学者 查看更多内容