.png){kind=icon}
返回
LF-Transformer: Latent Factorizer Transformer for Tabular Learning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3354972.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The field of deep learning for tabular datasets has made significant strides in recent times. Previously, gradient boosting and decision tree algorithms had been the go-to options for processing such datasets due to their superior performance. However, deep learning has now reached a level of development where it can compete with these algorithms on equal footing. Accordingly, we propose latent factorizer transformer (LF-Transformer). Our proposing method, LF-Transformer, involves applying the transformer architecture to columns and rows of a given dataset to identify the attention latent factor matrix. This matrix is then used for prediction. The process is akin to matrix factorization, which involves breaking down the original matrix into a latent matrix and then reconstructing it again. Our experimental results indicate that the LF-Transformer approach outperforms general feature embedding methods, providing superior feature presentation. Additionally, the approach has demonstrated a relative superiority in regression and classification across various datasets that we have tested. In conclusion, the LF-Transformer presents a promising direction for deep learning approaches in tabular datasets. Its ability to identify latent factors and provide superior performance in regression and classification makes it a compelling alternative to traditional algorithms.
Keyword:
Tabular dataset
tabular learning
self-attention
row-wise attention
column-wise attention
matrix factorization
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction
PREAI
分享收藏Searching for exotic particles in high-energy physics with deep learning用深度学习寻找高能物理中的奇异粒子.png)
NATURE COMMUNICATIONS
NATURE COMMUNICATIONSIF15.7
PREAI
分享收藏
查看更多内容