arrow
Return

TransACO: Transformer-Guided Ant Colony Algorithm for Combinatorial Optimization

delete2026-05-11
delete0
PRE
AI
B
Bo Sun
P
Peixi Peng
G
Guang Tan
Y
Yanjie Song
Y
Yongjun Tian
W
Witold Pedrycz
DOI:10.1109/tetci.2026.3683773delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Ant Colony Optimization (ACO) is a heuristic algorithm that has been widely used to solve combinatorial optimization problems. However, determining heuristic measures and initial pheromones levels in an ACO is problem-specific and often requires expert intervention, posing a significant challenge for the users. We investigate how the Transformer, a powerful learning model based on a self-attention mechanism, can be used to enable the automatic design of heuristic measures and pheromones. We present Transformer-Guided ACO (TransACO), a framework that combines neural methods with heuristic algorithms. The Transformer is designed as a learner that encodes problem instances, captures individual interactions, and generates heuristic measures and pheromone matrix. Additionally, a candidate point perturbation local search technique is proposed to enhance exploration. We conduct extensive experiments on four representative combinatorial optimization problems—traveling salesman problem, capacitated vehicle routing problem, orienteering problem, and multiple knapsack problem—across diverse instance sizes. Notably, in cross-scale generalization experiments, a model trained solely on small instances successfully transfers to 10k-node problems: on TSP-10 k, TransACO achieves a 4.12% improvement, and on CVRP-10 k, it yields a 1.16% gain over strong baselines. These findings demonstrate the robustness, adaptability, and scalability of TransACO.
Keywords:
Ant colony optimization
combinatorial optimization
transformer
deep learning

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

S
Sun Yat-Sen University
Scholars:
1.1W
Papers: 3.0K
Citations: 0
P
Peng Cheng Laboratory
Scholars:
1.7K
Papers: 1.8K
Citations: 2.0K
D
Dalian Maritime University
Scholars:
1.2W
Papers: 7.9K
Citations: 6.3K
S
silesian university of technology
Scholars:
1.2K
Papers: 596
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Multi-Objective Neural Evolutionary Algorithm for Combinatorial Optimization Problems
err2023-04-01
err68
PREAI
errShao, Yinan; Lin, Jerry Chun-Wei; Srivastava, Gautam; Guo, Dongdong; Zhang, Hongchun; Yi, Hu; Jolfaei, Alireza
errShare
errSave
errShare
errSave
Learning-Based Neural Ant Colony Optimization
err2023-07-12
err0
errOAAI
errYi Liu; Jiang Qiu; Emma Hart; Yilan Yu; Zhongxue Gan; Wei Li
errShare
errSave
Learning Heuristics for the TSP by Policy Gradient
err2018-06-08
err0
PREAI
errMichel Deudon; Pierre Cournut; Alexandre Lacoste; Yossiri Adulyasak; Louis-Martin Rousseau
errShare
errSave
Minimizing the searching time of multiple targets in uncertain environments with multiple UAVs
err2024-04-01
err4
errOAAI
errPerez-Carabaza, Sara; Besada-Portas, Eva; Lopez-Orozco, Jose A.
errShare
errSave
errShare
errSave
researcher View more