返回
Graph Transformers: A Survey
DOI:10.1109/tnnls.2025.3646122.png)
摘要
En 中文
Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility across various graph-related tasks. This survey provides an in-depth review of recent progress and challenges in graph transformer research. We begin with foundational concepts of graphs and transformers. We then explore design perspectives of graph transformers, focusing on how they integrate graph inductive biases and graph attention mechanisms into the transformer architecture. Furthermore, we propose a taxonomy classifying graph transformers based on depth, scalability, and pretraining strategies, summarizing key principles for effective development of graph transformer models. Beyond technical analysis, we discuss the applications of graph transformer models for node-level, edge-level, and graph-level tasks, exploring their potential in other application scenarios as well. Finally, we identify remaining challenges in the field, such as scalability and efficiency, generalization and robustness, interpretability and explainability, dynamic and complex graphs, as well as data quality and diversity, charting future directions for graph transformer research.
Keyword:
Attention
graph learning
graph neural network (GNN)
graph transformer
network embedding
representation learning
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Artificial Intelligence and Data Mining for the Pharmacovigilance of Drug-Drug Interactions用于药物-药物相互作用的药物警戒的人工智能和数据挖掘
A learning-based method for drug-target interaction prediction based on feature representation learning and deep neural network基于特征表示学习和深度神经网络的药物-靶标相互作用预测方法
Rethinking Positional Encoding in Tree Transformer for Code Representation重新思考树形Transformer中用于代码表示的位置编码

