arrow
Return

A Systematic Survey on Large Language Models for Algorithm Design

delete2026-05-23
delete2
PRE
AI
F
Fei Liu *
Y
Yiming Yao
P
Ping Guo
杨
杨志远 (Zhiyuan Yang)
N
Noah's, Huawei
L
Lin, Xi
M
Mao, Kun
Z
Zhao, Zhe
T
Tong, Xialiang
L
Lu, Zhichao
W
Wang, Zhenkun
Y
Yuan, Mingxuan
Z
Zhang, Qingfu
DOI:10.1145/3787585delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Algorithm design is crucial for effective problem-solving across various domains. The advent of Large Language Models (LLMs) has notably enhanced the automation and innovation within this field, offering new perspectives and promising solutions. In just a few years, this integration has yielded remarkable progress in areas ranging from combinatorial optimization to scientific discovery. Despite this rapid expansion, a holistic understanding of the field is hindered by the lack of a systematic review, as existing surveys either remain limited to narrow sub-fields or with different objectives. This article seeks to provide a systematic review of algorithm design with LLMs. We introduce a taxonomy that categorizes the roles of LLMs as optimizers, predictors, extractors, and designers, analyzing the progress, advantages, and limitations within each category. We further synthesize literature across the three phases of the algorithm design pipeline and across diverse algorithmic applications that define the current landscape. Finally, we outline key open challenges and opportunities to guide future research.
Keywords:
Algorithm design
large language model
LLM4AD
optimization
heuristic
evolutionary algorithm

Journal

ACM Computing Surveys cover
ACM Computing Surveys
IF:
28
Papers:
2.5K
Citations:
3.5W

Organization

H
huawei technologies
Scholars:
3.3K
Papers: 2.9K
Citations: 1
X
xi'an jiaotong university
Scholars:
9.3W
Papers: 6.7W
Citations: 75
S
southern university of science & technology
Scholars:
1.3K
Papers: 479
Citations: 0
C
city university of hong kong
Scholars:
5.8K
Papers: 3.3K
Citations: 2
researcher View more organizations
Cited Papers

Cited Papers

Hybrid Near-Field and Far-Field XL-MIMO: How Many Users Can Be Supported?
err2024-10-01
err1
PREAI
errZhang, Yuze; Yang, Ziang; Yue, Shaohua; Liu, Liang; Di, Boya
errShare
errSave
Large language model-based evolutionary optimizer: Reasoning with elitism
err2025-03-01
err0
PREAI
errBrahmachary, Shuvayan; Joshi, Subodh M.; Panda, Aniruddha; Koneripalli, Kaushik; Sagotra, Arun Kumar; Patel, Harshil; Sharma, Ankush; Jagtap, Ameya D.; Kalyanaraman, Kaushic
errShare
errSave
errShare
errSave
Mathematical discoveries from program search with large language models
err2023-12-14
err0
errOAAI
errBernardino Romera-Paredes; Mohammadamin Barekatain; Alexander Novikov; Matej Balog; M. Pawan Kumar; Emilien Dupont; Francisco J. R. Ruiz; Jordan S. Ellenberg; Pengming Wang; Omar Fawzi; Pushmeet Kohli; Alhussein Fawzi
errShare
errSave
researcher View more