arrow
返回

Large language models discover complementary heuristics for combinatorial optimization

delete2026-10-01
delete0
PRE
AI
H
Huatian Gong
S
Shuaian Wang
D
Dong‐Ping Song
J
Jiuh‐Biing Sheu
R
Ran Yan *
DOI:10.1038/s42256-026-01307-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
组合优化(CO)支撑着科学、工程和工业领域的决策制定,特别是在制造、物流、医疗运营和能源管理方面。然而,为每个新的问题变体设计有效的启发式算法需要深厚的领域知识和数月的专家迭代。直接提示大型语言模型(LLMs)可以生成可执行代码,但单次合成完整的启发式算法在新的CO问题上常规失败。本文引入了基于互补进化的LLM驱动算法构造(LACE),该框架将算法设计分解为输入模式、输出模式、工具库和启发式算法组合($${\mathcal{I}}$$–$${\mathcal{O}}$$–$${\mathcal{T}}$$–$${\mathcal{H}}$$接口),并通过时间约束的互补进化优化该组合。该接口在验证的问题合约下指导LLM的操作,将模型能力引导至高层算法推理而非问题特定实现。互补进化随后迭代生成和选择能够严格运行时预算内解决异构实例的专业化启发式算法。在36个经典CO-Bench问题上,LACE达到平均分数0.945,高于现有最强LLM基方法的0.870和未使用任何框架的直接LLM提示的0.571,增益源于框架而非模型。在四个结构新问题上,LACE达到0.97–0.99,而五种现有LLM基基线无法生成任何可行算法。这些结果表明,此类问题的有效算法发现可以自动化到相当大的程度。Gong等人开发了LACE,这是一个基于大型语言模型的框架,用于设计优化算法。它构建验证的问题合约,然后进化互补启发式算法组合,共同解决单个方法无法处理的问题。

期刊

Nature Machine Intelligence 封面图
Nature Machine Intelligence
IF:
23.9
论文数:
1.3K
被引数:
1.5W

机构

T
the hong kong polytechnic university
学者数:
553
论文数: 258
被引数: 0
N
nanyang technological university
学者数:
781
论文数: 388
被引数: 0
U
University of Liverpool
学者数:
470
论文数: 221
被引数: 0
N
national taiwan university
学者数:
763
论文数: 279
被引数: 0
学者 查看更多机构
引用论文

引用论文

Large language models surpass human experts in predicting neuroscience results大型语言模型在预测神经科学结果方面超越人类专家
err2024-11-27
err0
errOAAI
errXiaoliang Luo; Akilles Rechardt; Guangzhi Sun; Kevin K. Nejad; Felipe Yáñez; Bati Yilmaz; Kangjoo Lee; Alexandra O. Cohen; Valentina Borghesani; Anton Pashkov; Daniele Marinazzo; Jonathan Nicholas; Alessandro Salatiello; Ilia Sucholutsky; Pasquale Minervini; Sepehr Razavi; Roberta Rocca; Elkhan Yusifov; Tereza Okalova; Nianlong Gu; Martin Ferianc; Mikail Khona; Kaustubh R. Patil; Pui-Shee Lee; Rui Mata; Nicholas E. Myers; Jennifer K. Bizley; Sebastian Musslick; Isil Poyraz Bilgin; Guiomar Niso; Justin M. Ales; Michael Gaebler; N. Apurva Ratan Murty; Leyla Loued-Khenissi; Anna Behler; Chloe M. Hall; Jessica Dafflon; Sherry Dongqi Bao; Bradley C. Love
err分享
err收藏
Tool Learning with Foundation Models使用基础模型进行工具学习
err2024-12-24
err0
errOAAI
errQin, YJ; Hu, SD; Lin, YK; Chen, WZ; Ding, N; Cui, GQ; Zeng, ZN; Zhou, XH; Huang, YF; Xiao, CJ; Han, C; Fung, YR; Su, YS; Wang, HD; Qian, C; Tian, RC; Zhu, KL; Liang, SH; Shen, XY; Xu, BK; Zhang, Z; Ye, YN; Li, BW; Tang, ZW; Yi, J; Zhu, YZ; Dai, ZN; Yan, L; Cong, X; Lu, YX; Zhao, WL; Huang, YX; Yan, JX; Han, X; Sun, X; Li, DH; Phang, J; Yang, C; Wu, TS; Ji, H; Li, GL; Liu, ZY; Sun, MS
err分享
err收藏
Mathematical discoveries from program search with large language models使用大型语言模型进行程序搜索的数学发现
err2023-12-14
err0
errOAAI
errBernardino Romera-Paredes; Mohammadamin Barekatain; Alexander Novikov; Matej Balog; M. Pawan Kumar; Emilien Dupont; Francisco J. R. Ruiz; Jordan S. Ellenberg; Pengming Wang; Omar Fawzi; Pushmeet Kohli; Alhussein Fawzi
err分享
err收藏
Toolformer: Language Models Can Teach Themselves to Use Tools
err2023-01-01
err0
PREAI
errCancedda,Nicola; Dessi,Roberto; Dwivedi-Yu,Jane; Hambro,Eric; Lomeli,Maria; Raileanu,Roberta; Schick,Timo; Scialom,Thomas; Zettlemoyer,Luke
err分享
err收藏
Hyper-heuristics: a survey of the state of the art
err2017-12-21
err0
errOAAI
errEdmund K Burke; Michel Gendreau; Matthew Hyde; Graham Kendall; Gabriela Ochoa; Ender Özcan; Rong Qu
err分享
err收藏
ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution
err2024-01-01
err0
PREAI
errBerto,Federico; Cao,Zhiguang; Hua,Chuanbo; Kim,Haeyeon; Park,Jinkyoo; Song,Guojie; Wang,Jiarui; Ye,Haoran
err分享
err收藏
Deep active optimization for complex systems复杂系统的深度主动优化
err2025-08-25
err0
errOAAI
errYe Wei; Bo Peng; Ruiwen Xie; Yangtao Chen; Yu Qin; Peng Wen; Stefan Bauer; Po-Yen Tung; Dierk Raabe
err分享
err收藏
Highly accurate protein structure prediction with AlphaFold基于AlphaFold的高精度蛋白质结构预测
err2021-07-15
err0
errOAAI
errJohn Jumper; Richard Evans; Alexander Pritzel; Tim Green; Michael Figurnov; Olaf Ronneberger; Kathryn Tunyasuvunakool; Russ Bates; Augustin Žídek; Anna Potapenko; Alex Bridgland; Clemens Meyer; Simon A. A. Kohl; Andrew J. Ballard; Andrew Cowie; Bernardino Romera-Paredes; Stanislav Nikolov; Rishub Jain; Jonas Adler; Trevor Back; Stig Petersen; David Reiman; Ellen Clancy; Michal Zielinski; Martin Steinegger; Michalina Pacholska; Tamas Berghammer; Sebastian Bodenstein; David Silver; Oriol Vinyals; Andrew W. Senior; Koray Kavukcuoglu; Pushmeet Kohli; Demis Hassabis
err分享
err收藏
学者 查看更多内容