A Systematic Survey on Large Language Models for Algorithm Design

Fei Liu

doi:10.1145/3787585

A Systematic Survey on Large Language Models for Algorithm Design

2026-05-23

2

PRE

AI

DOI：10.1145/3787585

Original request for help

Save

Abstract

En 中文

Algorithm design is crucial for effective problem-solving across various domains. The advent of Large Language Models (LLMs) has notably enhanced the automation and innovation within this field, offering new perspectives and promising solutions. In just a few years, this integration has yielded remarkable progress in areas ranging from combinatorial optimization to scientific discovery. Despite this rapid expansion, a holistic understanding of the field is hindered by the lack of a systematic review, as existing surveys either remain limited to narrow sub-fields or with different objectives. This article seeks to provide a systematic review of algorithm design with LLMs. We introduce a taxonomy that categorizes the roles of LLMs as optimizers, predictors, extractors, and designers, analyzing the progress, advantages, and limitations within each category. We further synthesize literature across the three phases of the algorithm design pipeline and across diverse algorithmic applications that define the current landscape. Finally, we outline key open challenges and opportunities to guide future research.

Keywords:

Algorithm design

large language model

LLM4AD

optimization

heuristic

evolutionary algorithm

A Systematic Survey on Large Language Models for Algorithm Design

Abstract

Journal

Organization