arrow
Return

Symmetric-Approximation Energy-Based Estimation of Distribution (SEED): A Continuous Optimization Algorithm

delete2019-01-01
delete3
delete
OA
AI
J
Juan de Anda-Suárez
M
Martin Carpio-Valadez, Juan
H
Hector J. Puga-Soberanese
V
Valentín Calzada-Ledesma *
A
Alfonso Rojas‐Domínguez *
S
S. Jeyakumar
A
Andrés Espinal
DOI:10.1109/ACCESS.2019.2948199delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Estimation of Distribution Algorithms (EDAs) maintain and iteratively update a probabilistic model to tackle optimization problems. The Boltzmann Probability Distribution Function (Boltzmann-PDF) provides advantages when used in energy based EDAs. However, direct sampling from the Boltzmann-PDF to update the probabilistic model is unpractical, and several EDAs employ an approximation to the Boltzmann-PDF by means of a Gaussian distribution that is usually derived by the minimization of the Kullback-Leibler divergence (KL-divergence) computed between the Gaussian and the Boltzmann-PDFs. The KL-divergence measure is not symmetric, and this causes the Gaussian approximation to fail at correctly modeling the target function for the EDAs, because the parameters of the Gaussian are not optimally estimated. In this paper, we derive an approximation to the Boltzmann-PDF using Jeffreys' divergence (a symmetric measure) in lieu of the KL-divergence and thus improve the performance of the optimization algorithm. Our approach is termed Symmetric-approximation Energy-based Estimation of Distribution (SEED) algorithm. The SEED algorithm is experimentally compared under a univariate approach against two other EDAs (UMDAc and BUMDA) on several benchmark optimization problems. The results show that the SEED algorithm is more effective and more efficient than the other algorithms.
Keywords:
Boltzmann selection
estimation of distribution algorithms
Kullback-Leibler divergence
J-divergence
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

I
instituto tecnologico de leon
Scholars:
34
Papers: 17
Citations: 0
Universidad de Guanajuato cover
Universidad de Guanajuato
Scholars:
3.9K
Papers: 2.8K
Citations: 1.9K