arrow
Return

Multi-indicator based multi-objective evolutionary algorithm with application to neural architecture search

delete2024-08-27
delete1
PRE
AI
O
Oladayo S. Ajani
D
Daison Darlan
D
Dzeuban Fenyom Ivan
R
Rammohan Mallipeddi *
DOI:10.1007/s13042-024-02300-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
ISDE+\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbf{I}}_{{\mathbf{SDE}}<^>{+}}$$\end{document} is proven to be one of the leading scalable indicator for evolutionary multi and many-objective optimization. However, it fails to segregate members of a given population beyond the first front as a large number of solutions in the population have identical ISDE+\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbf{I}}_{{\mathbf{SDE}}<^>{+}}$$\end{document} values. This mainly affects the performance of the algorithm when handling optimization problems with lower objectives. Consequently, we hypothesize that the overall performance of the algorithm can be further improved by introducing a categorization mechanism similar to the categorization of Pareto Fronts (PFs) in dominance-based methods. Therefore, in this work, we propose a Multi-Indicator-Based Multi-Objective Evolutionary Algorithm (MI-MOEA) which categorizes all the solutions into different fronts. Specifically, the indicators are based on the popular ISDE+\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbf{I}}_{{\mathbf{SDE}}<^>{+}}$$\end{document} indicator and make use of the minimum and median distance values among the different distances when the solutions with better Sum of Objectives (SOB) are projected. The use of these two ISDE+\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${\mathbf{I}}_{{\mathbf{SDE}}<^>{+}}$$\end{document}-based indicator values features an efficient balance of exploration and exploitation. To evaluate the performance of the proposed MI-MOEA, Neural Architecture Search (NAS) which involves the design of appropriate architectures suitable for specific applications is employed. From an optimization perspective, NAS involves multiple conflicting objectives that needs to be simultaneously optimized. In this paper, we consider a recently proposed multi-objective NAS benchmark and favorably evaluate the performance of MI-MOEA compared to other state-of-the-art MOEAs.
Keywords:
Evolutionary multi-objective optimization
Indicator-based evolutionary algorithm
Neural architecture search

Journal

International Journal of Machine Learning and Cybernetics cover
International Journal of Machine Learning and Cybernetics
IF:
2.7
Papers:
3.1K
Citations:
5.6K

Organization

K
kyungpook national university (knu)
Scholars:
1.8W
Papers: 1.8W
Citations: 14