arrow
返回

Graph Transformers: A Survey

delete2026-01-12
delete0
PRE
AI
A
Ahsan Shehzad
F
Feng Xia
S
Shagufta Abid
C
Ciyuan Peng
S
Shuo Yu
D
Dongyu Zhang
K
Karin Verspoor
DOI:10.1109/tnnls.2025.3646122delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility across various graph-related tasks. This survey provides an in-depth review of recent progress and challenges in graph transformer research. We begin with foundational concepts of graphs and transformers. We then explore design perspectives of graph transformers, focusing on how they integrate graph inductive biases and graph attention mechanisms into the transformer architecture. Furthermore, we propose a taxonomy classifying graph transformers based on depth, scalability, and pretraining strategies, summarizing key principles for effective development of graph transformer models. Beyond technical analysis, we discuss the applications of graph transformer models for node-level, edge-level, and graph-level tasks, exploring their potential in other application scenarios as well. Finally, we identify remaining challenges in the field, such as scalability and efficiency, generalization and robustness, interpretability and explainability, dynamic and complex graphs, as well as data quality and diversity, charting future directions for graph transformer research.
Keyword:
Attention
graph learning
graph neural network (GNN)
graph transformer
network embedding
representation learning

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

F
Federation University Australia
学者数:
2.0K
论文数: 2.3K
被引数: 17
R
RMIT University
学者数:
3.1K
论文数: 1.7K
被引数: 2.6W
D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Mask and Reason
err2022-08-14
err0
errOAAI
errXiao Liu; Shiyu Zhao; Kai Su; Yukuo Cen; Jiezhong Qiu; Mengdi Zhang; Wei Wu; Yuxiao Dong; Jie Tang
err分享
err收藏
EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference
err2021-10-17
err0
errOAAI
errThierry Tambe; Coleman Hooper; Lillian Pentecost; Tianyu Jia; En-Yu Yang; Marco Donato; Victor Sanh; Paul Whatmough; Alexander M. Rush; David Brooks; Gu-Yeon Wei
err分享
err收藏
学者 查看更多内容