arrow
Return

ITSO: a novel inverse transform sampling-based optimization algorithm for stochastic search

delete2021-04-26
delete5
delete
OA
AI
N
Nikolaos Bakas *
V
Vagelis Plevris
A
Andreas Langousis
S
Savvas A. Chatzichristofis
DOI:10.1007/s00477-021-02025-wdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Optimization algorithms appear in the core calculations of numerous Artificial Intelligence (AI) and Machine Learning methods and Engineering and Business applications. Following recent works on AI's theoretical deficiencies, a rigour context for the optimization problem of a black-box objective function is developed. The algorithm stems directly from the theory of probability, instead of presumed inspiration. Thus the convergence properties of the proposed methodology are inherently stable. In particular, the proposed optimizer utilizes an algorithmic implementation of the n-dimensional inverse transform sampling as a search strategy. No control parameters are required to be tuned, and the trade-off among exploration and exploitation is, by definition, satisfied. A theoretical proof is provided, concluding that when falling into the proposed framework, either directly or incidentally, any optimization algorithm converges. The numerical experiments verify the theoretical results on the efficacy of the algorithm apropos reaching the sought optimum.
Keywords:
Stochastic optimization
Inverse transform sampling
Black-box function
Global convergence
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Stochastic Environmental Research and Risk Assessment cover
Stochastic Environmental Research and Risk Assessment
IF:
3.6
Papers:
3.5K
Citations:
6.9K

Organization

Q
Qatar University
Scholars:
8.9K
Papers: 9.0K
Citations: 16
U
University of Patras
Scholars:
1.2W
Papers: 9.5K
Citations: 8.4K