arrow
Return

LLMOA: A novel large language model assisted hyper-heuristic optimization algorithm

delete2025-03-01
delete0
PRE
AI
R
Rui Zhong
A
Abdelazim G. Hussien *
J
Jun Yu
M
Masaharu Munetomo
DOI:10.1016/j.aei.2024.103042delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This work presents a novel approach, the large language model assisted hyper-heuristic optimization algorithm (LLMOA), tailored to address complex optimization challenges. Comprising two essential components - the high-level component and the low-level component - LLMOA leverages the LLM (i.e., Gemini) with prompt engineering in its high-level component to construct optimization sequences automatically and intelligently. Furthermore, we propose novel elite-based local search operators as low-level heuristics (LLHs), which draw inspiration from the proximate optimality principle (POP). These local search operators cooperated with wellknown mutation and crossover operators from differential evolution (DE), at a total of ten efficient and versatile search operators, forming the whole LLHs. To assess the competitiveness of LLMOA, we conducted comprehensive numerical experiments across CEC2014, CEC2020, CEC2022, and ten engineering optimization problems, benchmarking against eleven state-of-the-art optimizers. Our experimental findings and statistical analyses underscore the powerfulness and effectiveness of LLMOA. Moreover, ablation experiments reveal the pivotal role of integrating the LLM Gemini and prompt engineering as the high-level component. Conclusively, this study provides a feasible avenue to introduce LLM to the evolutionary computation (EC) community. The research's source code is available for download at https://github.com/RuiZhong961230/LLMOA.
Keywords:
Hyper-heuristic algorithm (HHA)
Large language model (LLM)
Prompt engineering
Low-level heuristics (LLHs)
Evolutionary computation (EC)

Journal

Advanced Engineering Informatics cover
Advanced Engineering Informatics
IF:
9.9
Papers:
4.4K
Citations:
1.7W

Organization

L
Linkoping University
Scholars:
1.6W
Papers: 1.5W
Citations: 184
F
Fayoum University
Scholars:
1.4K
Papers: 1.3K
Citations: 2.4K
H
Hokkaido University
Scholars:
3.6W
Papers: 2.5W
Citations: 2.6W
researcher View more organizations
Cited Papers

Cited Papers

Characterization of the emerging multidrug‐resistant Salmonella enterica serotype Kentucky ST314 in China
err2021-05-18
err0
PREAI
errShaojun Wang; Xinmeng Liao; Zhiying Xiong; Qijie Lin; Junping Wen; Chenggang Xu; Xiaoyun Qu; Kaifeng Chen; Jianmin Zhang
errShare
errSave
Fick?s Law Algorithm: A physical law-based algorithm for numerical optimization
err2023-01-01
err127
PREAI
errHashim, Fatma A.; Mostafa, Reham R.; Hussien, Abdelazim G.; Mirjalili, Seyedali; Sallam, Karam M.
errShare
errSave
Grey Wolf Optimizer
err2014-03-01
err1.3W
PREAI
errMirjalili, Seyedali; Mirjalili, Seyed Mohammad; Lewis, Andrew
errShare
errSave
High Temperature Electrochemical Separation of Carbon Dioxide Using Molten Carbonate
err1998-06-05
err0
errOAAI
errHidekazu KASAI; Takahiro MATSUO; Minoru HOSAKA; Naobumi MOTOHIRA; Nobuyuki KAMIYA; Ken-ichiro OTA
errShare
errSave
Comprehensive learning particle swarm optimizer for global optimization of multimodal functions
err2006-06-01
err3.2K
PREAI
errLiang, J. J.; Qin, A. K.; Suganthan, Ponnuthurai Nagaratnam; Baskar, S.
errShare
errSave
Walrus optimizer: A novel nature-inspired metaheuristic algorithm
err2024-04-01
err49
PREAI
errHan, Muxuan; Du, Zunfeng; Yuen, Kum Fai; Zhu, Haitao; Li, Yancang; Yuan, Qiuyu
errShare
errSave
researcher View more