.png){kind=icon}
Return
A Simple Yet Efficient Evolution Strategy for Large-Scale Black-Box Optimization
.png){kind=icon}
PRE
AI
DOI：10.1109/TEVC.2017.2765682.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We propose an evolution strategy algorithm using a sparse plus low rank model for large-scale optimization in this paper. We first develop a rank one evolution strategy using a single principal search direction. It is of linear complexity. Then we extend it to multiple search directions, and develop a rank-m evolution strategy. We illustrate that the principal search direction accumulates the natural gradients with respect to the distribution mean, and acts as a momentum term. Further, we analyze the optimal low rank approximation to the covariance matrix, and experimentally show that the principal search direction can effectively learn the long valley of the function with predominant search direction. Then we investigate the effects of Hessian on the algorithm performance. We conduct experiments on a class of test problems and the CEC'2010 LSGO benchmarks. The experimental results validate the effectiveness of our proposed algorithms.
Keywords:
Evolution path
evolution strategy
low rank model
principal search direction
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
12
Papers:
1.9K
Citations:
2.4W
Organization
Cited Papers
ShareSaveSteepest descent with momentum for quadratic functions is a version of the conjugate gradient method.png)
NEURAL NETWORKS
OAAI
NEURAL NETWORKSIF6.3
OAAIShareSaveShareSaveTranscranial direct current stimulation on prefrontal and parietal areas enhances motor imageryNeuroReport
NeuroReportIF0
PREAI
ShareSaveShareSaveShareSave
View more