1
Return

A transformer-enhanced framework for estimating student performance in mathematics

delete2026-04-01
delete0
PRE
AI
W
Wang, Xinyi *
Z
Zhang, He
DOI:10.7717/peerj-cs.3692delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Estimating student performance is a crucial focus in educational research, significantly impacting academic outcomes and instructional strategies. This article investigates the application of advanced deep learning techniques for predicting student performance based on heterogeneous tabular data. We propose a novel hybrid architecture that combines a Hybrid Transformer module with a Multi-Layer Perceptron (MLP) layer, designed to effectively capture both static and dynamic feature interactions. Motivated by recent advancements in Transformer-based models for tabular data, our approach integrates self-attention mechanisms with feed-forward pathways to enhance feature learning. Experimental results demonstrate that the proposed model outperforms traditional machine learning methods and state-of-the-art tabular deep learning architectures across multiple evaluation metrics. These findings highlight the potential of hybrid Transformer-MLP architectures in optimizing predictive analytics for educational outcomes.
Keywords:
Student performance prediction
Transformer-based deep learning
Educational data mining
Tabular data modeling
Hybrid neural network architecture

Journal

PeerJ Computer Science cover
PeerJ Computer Science
IF:
2.5
Papers:
3.3K
Citations:
6.9K

Organization

J
jiamusi university
Scholars:
693
Papers: 182
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers