arrow
Return

TLTD: Transfer Learning for Tabular Data

delete2023-11-01
delete5
PRE
AI
M
Maxim Bragilovski
L
Lior Rokach *
S
Shelly Levy‐Tzedek *
DOI:10.1016/j.asoc.2023.110748delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep Neural Networks (DNNs) have become effective for various machine learning tasks. DNNs are known to achieve high accuracy with unstructured data in which each data sample (e.g., image) consists of many raw features (e.g., pixels) of the same type. The effectiveness of this approach diminishes for structured (tabular) data. In most cases, decision tree-based models such as Random Forest (RF) or Gradient Boosting Decision Trees (GBDT) outperform DNNs. In addition, DNNs tend to perform poorly when the number of samples in the dataset is small. This paper introduces Transfer Learning for Tabular Data (TLTD) which utilizes a novel learning architecture designed to extract new features from structured datasets. Using the DNN's learning capabilities on images, we convert the tabular data into images, then use the distillation technique to achieve better learning. We evaluated our approach with 25 structured datasets, and compared the outcomes to those of RF, eXtreme Gradient Boosting (XGBoost), Tabnet, KNN, and TabPFN. The results demonstrate the usefulness of the TLTD approach.& COPY; 2023 Elsevier B.V. All rights reserved.
Keywords:
Deep-learning
Feature-extraction
Tabular datasets

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

B
ben gurion university
Scholars:
1.3W
Papers: 1.0W
Citations: 5
Cited Papers

Cited Papers

Knowledge Distillation: A Survey
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
errShare
errSave
Transfer learning in computer vision tasks: Remember where you come from
err2020-01-01
err56
errOAAI
errLi, Xuhong; Grandvalet, Yves; Davoine, Franck; Cheng, Jingchun; Cui, Yin; Zhang, Hang; Belongie, Serge; Tsai, Yi-Hsuan; Yang, Ming-Hsuan
errShare
errSave
Converting tabular data into images for deep learning with convolutional neural networks
err2021-05-31
err132
errOAAI
errZhu, Yitan; Brettin, Thomas; Xia, Fangfang; Partin, Alexander; Shukla, Maulik; Yoo, Hyunseung; Evrard, Yvonne A.; Doroshow, James H.; Stevens, Rick L.
errShare
errSave
A survey of transfer learning
err2016-05-28
err0
errOAAI
errKarl Weiss; Taghi M. Khoshgoftaar; DingDing Wang
errShare
errSave
Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection
err2017-12-01
err682
errOAAI
errGopalakrishnan, Kasthurirangan; Khaitan, Siddhartha K.; Choudhary, Alok; Agrawal, Ankit
errShare
errSave
A Survey on Transfer Learning
err2010-10-01
err1.4W
PREAI
errPan, Sinno Jialin; Yang, Qiang
errShare
errSave
Tabular data: Deep learning is not all you need
err2022-05-01
err595
errOAAI
errShwartz-Ziv, Ravid; Armon, Amitai
errShare
errSave
researcher View more