arrow
Return

Vector Optimization with Gaussian Process Bandits

delete2026-03-23
delete0
delete
OA
AI
İ
İlter Onat Korkmaz
Y
Yaşar Cahit Yıldırım
Ç
Çağın Ararat
C
Cem Tekin *
DOI:10.1007/s10994-026-07024-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We study black-box vector optimization with Gaussian process bandits, where there is an incomplete order relation on objective vectors described by a polyhedral convex cone. Existing black-box vector optimization approaches either suffer from high sample complexity or lack theoretical guarantees. We propose Vector Optimization with Gaussian Process (VOGP), an adaptive elimination algorithm that identifies Pareto optimal solutions sample efficiently by exploiting the smoothness of the objective function. We establish theoretical guarantees, deriving information gain-based and kernel-specific sample complexity bounds. Finally, we conduct a thorough empirical evaluation of VOGP and compare it with the state-of-the-art multi-objective and vector optimization algorithms on several real-world and synthetic datasets, emphasizing VOGP’s efficiency (e.g., $$\sim 18\times$$ lower sample complexity on average). We also provide heuristic adaptations of VOGP for cases where the design space is continuous and where the Gaussian process model lacks access to the true kernel hyperparameters. This work opens a new frontier in sample-efficient multi-objective black-box optimization by incorporating preference structures while maintaining theoretical guarantees and practical efficiency.
Keywords:
Vector optimization
Ordering cones
Gaussian process bandits
Bayesian optimization
Sample complexity bounds
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

B
Bilkent University
Scholars:
274
Papers: 139
Citations: 0