arrow
返回

A general deep reinforcement learning hyperheuristic framework for solving combinatorial optimization problems

delete2023-08-01
delete36
delete
OA
AI
J
Jakob Vigerust Kallestad
R
Ramin Hasibi *
A
Ahmad Hemmati
K
Kenneth Sörensen
DOI:10.1016/j.ejor.2023.01.017delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Many problem-specific heuristic frameworks have been developed to solve combinatorial optimization problems, but these frameworks do not generalize well to other problem domains. Metaheuristic frameworks aim to be more generalizable compared to traditional heuristics, however their performances suffer from poor selection of low-level heuristics (operators) during the search process. An example of heuristic selection in a metaheuristic framework is the adaptive layer of the popular framework of Adaptive Large Neighborhood Search (ALNS). Here, we propose a selection hyperheuristic framework that uses Deep Reinforcement Learning (Deep RL) as an alternative to the adaptive layer of ALNS. Unlike the adaptive layer which only considers heuristics' past performance for future selection, a Deep RL agent is able to take into account additional information from the search process, e.g., the difference in objective value between iterations, to make better decisions. This is due to the representation power of Deep Learning methods and the decision making capability of the Deep RL agent which can learn to adapt to different problems and instance characteristics. In this paper, by integrating the Deep RL agent into the ALNS framework, we introduce Deep Reinforcement Learning Hyperheuristic (DRLH), a general framework for solving a wide variety of combinatorial optimization problems and show that our framework is better at selecting low-level heuristics at each step of the search process compared to ALNS and a Uniform Random Selection (URS). Our experiments also show that while ALNS can not properly handle a large pool of heuristics, DRLH is not negatively affected by increasing the number of heuristics. (c) 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
Keyword:
Heuristics
Hyperheuristic
Adaptive metaheuristic
Deep reinforcement learning
Combinatorial optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

European Journal of Operational Research 封面图
European Journal of Operational Research
IF:
6
论文数:
2.2W
被引数:
6.4W

机构

U
university of bergen
学者数:
2.0W
论文数: 1.7W
被引数: 19
引用论文

引用论文

Janus Graft Block Copolymers: Design of a Polymer Architecture for Independently Tuned Nanostructures and Polymer Properties
err2018-05-15
err0
PREAI
errZi‐Hao Guo; An N. Le; Xunda Feng; Youngwoo Choo; Bingqian Liu; Danyu Wang; Zhengyi Wan; Yuwei Gu; Julia Zhao; Vince Li; Chinedum O. Osuji; Jeremiah A. Johnson; Mingjiang Zhong
err分享
err收藏
OPTIMIZATION BY SIMULATED ANNEALING模拟退火优化
errSCIENCE
IF45.8
err1983-05-13
err3.2W
PREAI
errKIRKPATRICK, S; GELATT, CD; VECCHI, MP
err分享
err收藏
学者 查看更多内容