arrow
Return

StructFormer: A Transformer-Based Multi-Structure Attention Model for Solving Routing Problems

delete2026-07-10
delete0
PRE
AI
L
Longze Liu
P
Peilan He
Y
Yanwei Yu
G
Guiyuan Jiang
Y
Yidan Sun
J
Junyu Dong
M
Muwei Jian
S
Siew-Kei Lam
DOI:10.1109/tits.2026.3709289delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Vehicle Routing Problems (VRPs), fundamental NP-hard challenges in intelligent transportation systems, often pose scalability challenges and require expert-dependent design when solved with traditional heuristics. Neural VRP solvers offer data-driven alternatives but suffer from limitations such as the “averaging effect” in self-attention, which impairs key-node differentiation and the modeling of salient structural relationships. Existing feature enhancement methods also overlook key structural patterns, limiting representation quality. To address these challenges, we propose StructFormer, a transformer-based improvement solver with multiview structural attention. Its core Multi-StructAttn module integrates multiview structural embeddings to mitigate the averaging effect, enhancing node differentiation and capturing salient structural relationships. Additionally, a global-centrality-based feature enhancement module embeds optimal connection patterns, enriching structural representation. A novel decoder further incorporates search-state-dependent dynamic heuristic information to improve step-wise decision-making during iterative refinement. Experiments on diverse TSP and CVRP benchmarks demonstrate that StructFormer consistently outperforms state-of-the-art models. Furthermore, some modules of StructFormer are compatible with other learning-based solvers, offering significant performance gains on both TSP and CVRP.
Keywords:
Vehicle routing problems
deep reinforcement learning
averaging effect
node structural embeddings
feature enhancement
local search

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.5K
Citations:
6.3W

Organization

O
ocean university of china
Scholars:
3.1W
Papers: 2.0W
Citations: 21
I
imperial college london
Scholars:
9.9K
Papers: 4.4K
Citations: 0
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
S
shandong university of finance and economics
Scholars:
194
Papers: 126
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

No cited papers available