arrow
Return

Global optimization based on active preference learning with radial basis functions

delete2020-12-28
delete33
delete
OA
AI
A
Alberto Bemporad *
D
Dario Piga
DOI:10.1007/s10994-020-05935-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a preference such as this is better than that between two candidate decision vectors. The algorithm described in this paper aims at reaching the global optimizer by iteratively proposing the decision maker a new comparison to make, based on actively learning a surrogate of the latent (unknown and perhaps unquantifiable) objective function from past sampled decision vectors and pairwise preferences. A radial-basis function surrogate is fit via linear or quadratic programming, satisfying if possible the preferences expressed by the decision maker on existing samples. The surrogate is used to propose a new sample of the decision vector for comparison with the current best candidate based on two possible criteria: minimize a combination of the surrogate and an inverse weighting distance function to balance between exploitation of the surrogate and exploration of the decision space, or maximize a function related to the probability that the new candidate will be preferred. Compared to active preference learning based on Bayesian optimization, we show that our approach is competitive in that, within the same number of comparisons, it usually approaches the global optimum more closely and is computationally lighter. Applications of the proposed algorithm to solve a set of benchmark global optimization problems, for multi-objective optimization, and for optimal tuning of a cost-sensitive neural network classifier for object recognition from images are described in the paper. MATLAB and a Python implementations of the algorithms described in the paper are available at .
Keywords:
Active preference learning
Preference-based optimization
Global optimization
Derivative-free algorithms
Black-box optimization
Surrogate models
Multi-objective optimization
Inverse distance weighting
Bayesian optimization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

I
IMT School for Advanced Studies Lucca
Scholars:
16
Papers: 15
Citations: 0
Cited Papers

Cited Papers

Mental health among younger and older caregivers of dementia patients
err2016-03-10
err0
PREAI
errAsuka Koyama; Masateru Matsushita; Mamoru Hashimoto; Noboru Fujise; Tomohisa Ishikawa; Hibiki Tanaka; Yutaka Hatada; Yusuke Miyagawa; Maki Hotta; Manabu Ikeda
errShare
errSave
Preparation and characteristics of crystallized mesoporous Zr6Nb2O17
err2004-11-01
err0
PREAI
errDaling Lu; Byongjin Lee; Junko N. Kondo; Kazunari Domen
errShare
errSave
Choice overload: A conceptual review and meta-analysis
err2014-08-29
err526
PREAI
errChernev, Alexander; Boeckenholt, Ulf; Goodman, Joseph
errShare
errSave
FACTORS ASSOCIATED WITH SEVERE INTRACRANIAL HYPERTENSION IN CANDIDATES FOR EMERGENCY LIVER TRANSPLANTATION
err1993-05-01
err0
errOAAI
errSANTIAGO J. MUÑOZ; MICHAEL J. MORIRZ; RODNEY BELL; BRUCE NORTHRUP; PAUL MARTIN; JOHN RADOMSKI
errShare
errSave
Transgenic systems in studies on genotoxicity of alkylating agents: critical lesions, thresholds and defense mechanisms
err1998-09-01
err0
PREAI
errBernd Kaina; Gerhard Fritz; Kirsten Ochs; Simone Haas; Thomas Grombacher; Jörg Dosch; Markus Christmann; Per Lund; Cornelia M Gregel; Klaus Becker
errShare
errSave
researcher View more

Related Insights

Failed to load related insights