.png){kind=icon}
.png){kind=icon}
Return
LLMOA: A novel large language model assisted hyper-heuristic optimization algorithm
.png){kind=icon}
PRE
AI
DOI：10.1016/j.aei.2024.103042.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This work presents a novel approach, the large language model assisted hyper-heuristic optimization algorithm (LLMOA), tailored to address complex optimization challenges. Comprising two essential components - the high-level component and the low-level component - LLMOA leverages the LLM (i.e., Gemini) with prompt engineering in its high-level component to construct optimization sequences automatically and intelligently. Furthermore, we propose novel elite-based local search operators as low-level heuristics (LLHs), which draw inspiration from the proximate optimality principle (POP). These local search operators cooperated with wellknown mutation and crossover operators from differential evolution (DE), at a total of ten efficient and versatile search operators, forming the whole LLHs. To assess the competitiveness of LLMOA, we conducted comprehensive numerical experiments across CEC2014, CEC2020, CEC2022, and ten engineering optimization problems, benchmarking against eleven state-of-the-art optimizers. Our experimental findings and statistical analyses underscore the powerfulness and effectiveness of LLMOA. Moreover, ablation experiments reveal the pivotal role of integrating the LLM Gemini and prompt engineering as the high-level component. Conclusively, this study provides a feasible avenue to introduce LLM to the evolutionary computation (EC) community. The research's source code is available for download at https://github.com/RuiZhong961230/LLMOA.
Keywords:
Hyper-heuristic algorithm (HHA)
Large language model (LLM)
Prompt engineering
Low-level heuristics (LLHs)
Evolutionary computation (EC)
Journal
IF:
9.9
Papers:
4.0K
Citations:
1.7W
View more organizations