.png){kind=icon}
.png){kind=icon}
Return
Structure-Aware Mamba: A Linear-Complexity Model for Graph Representation Learning With Global Receptive Fields
.png){kind=icon}
PRE
AI
DOI：10.1177/30504554261417569.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Graph neural networks (GNNs) and graph transformers (GTs) have shown significant potential in handling graph-structured data. However, GNNs face challenges with over-squashing and over-smoothing, hindering their ability to capture long-range dependencies. GTs can address this through a global attention mechanism, but suffer from high computational overhead due to their quadratic complexity. The selective state space model (SSM), Mamba, known for its linear complexity and excellent performance, offers an attractive alternative. However, Mamba lacks graph inductive biases and handles only sequential data. To ress hese challenges, we propose a new SSM framework with global receptive fields and structure-aware capabilities. We address Mamba's limitations by repeating node sequences and incorporating a structural encoder to enhance inductive bias. Experiments on eight benchmarks demonstrate competitive accuracy as well as superior speed and scalability over GTs, underscoring the potential of SSMs for graph learning.
Keywords:
graph neural networks
selective state space model
graph representation learning
structure-aware mamba
Journal
E
IF:
0
Papers:
40
Citations:
0