arrow
Return

Comparative Study of Derivative Free Optimization Algorithms

delete2011-11-01
delete51
PRE
AI
N
Nam Pham *
A
A. Malinowski
T
Tomasz Bartczak
DOI:10.1109/TII.2011.2166799delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Derivative free optimization algorithms are often used when it is difficult to find function derivatives, or if finding such derivatives are time consuming. The Nelder Mead's simplex method is one of the most popular derivative free optimization algorithms in the fields of engineering, statistics, and sciences. This algorithm is favored and widely used because of its fast convergence and simplicity. The simplex method converges really well with small scale problems of some variables. However, it does not have much success with large-scale problems of multiple variables. This factor has reduced its popularity in optimization sciences significantly. Two solutions of quasi-gradients are introduced to improve it in terms of the convergence rate and the convergence speed. The improved algorithm with higher success rate and faster convergence which still maintains the simplicity is the key feature of this paper. This algorithm will be compared on several benchmark functions with other popular optimization algorithms such as the genetic algorithm, the differential evolution algorithm, the particle swarm algorithm, and the original simplex method. Then, the comparing results will be reported and discussed.
Keywords:
Simplex method
genetic algorithm (GA)
differential evolution algorithm (DE)
particle swarm optimization (PSO)
quasi-gradient method
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Industrial Informatics cover
IEEE Transactions on Industrial Informatics
IF:
9.9
Papers:
8.3K
Citations:
6.0W

Organization

A
Auburn University
Scholars:
7.2K
Papers: 5.8K
Citations: 1.3W
A
auburn university system
Scholars:
1.1W
Papers: 9.5K
Citations: 9
Bradley University cover
Bradley University
Scholars:
448
Papers: 403
Citations: 401
researcher View more organizations