1
Return

Multi-Head TextGCN: leveraging multi-head attention for enhanced document classification

delete2026-06-02
delete0
PRE
AI
D
Danial Toufani-Movaghar
M
Mohammad-Reza Feizi-Derakhshi *
B
Behrooz Koohestani
DOI:10.1007/s10586-026-06063-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this work, we propose Multi-Head TextGCN, a novel extension of the traditional TextGCN that integrates multi-head attention mechanisms into the graph convolutional process. By modeling document and word nodes jointly within a graph and implementing multiple specialized attention heads to capture local, global, and topical semantic interactions, our approach learns richer and more robust feature representations for document classification. Extensive evaluations on several benchmark datasets demonstrate that our model achieves significant improvements in classification accuracy, proving especially effective in low-resource and few-shot learning scenarios. These promising results underscore the potential of our heterogeneous multi-head framework for advancing graph-based text representation learning.
Keywords:
Document classification
TextGCN
Multi-head attention
Graph neural networks
Low-resource scenarios
Natural language processing
Semi-supervised learning

Journal

C
Cluster Computing
IF:
0
Papers:
691
Citations:
1

Organization

C
Computer Engineering
Scholars:
178
Papers: 91
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers