arrow
Return

Federated Bayesian optimization on random Fourier additive margin features and random kernel mapping

delete2025-05-01
delete0
PRE
AI
江发真 cover
江发真 (Fazhen Jiang)
杨
杨小远 (Xiaoyuan Yang) *
DOI:10.1016/j.asoc.2025.112925delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Bayesian Optimization (BO) is an advanced technique for hyperparameter tuning in AutoML, particularly for optimizing black-box functions. This study mainly proposes the RAF kernel for Gaussian Processes and introduces two novel algorithms: the Federated Bayesian additive marginal Thompson Sampling algorithm (FAT) and the Federated Bayesian random kernel Thompson Sampling algorithm (FAKT), the latter combining RAF with Random Fourier Features (RFF). To enhance privacy, we further develop DP-FAT and DP-FAKT by integrating Differential Privacy, which can reduce the communication costs while safeguarding client data. Experiments show that FAT and FAKT converge 10 communication rounds faster than existing methods (e.g., FTS), significantly improving efficiency in federated black-box optimization. These advancements demonstrate strong potential for large-scale learning tasks with enhanced privacy and reduced overhead.
Keywords:
Federated learning
Bayesian optimization
Random kernel mapping
Data heterogeneity
Differentially private

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

No organization information available
Cited Papers

Cited Papers

D2PAM: Epileptic seizures prediction using adversarial deep dual patch attention mechanism
err2023-07-29
err21
errOAAI
errKhan, Arfat Ahmad; Madendran, Rakesh Kumar; Thirunavukkarasu, Usharani; Faheem, Muhammad
errShare
errSave
Taking the Human Out of the Loop: A Review of Bayesian Optimization
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
errShare
errSave
FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge Computing
err2021-12-01
err104
errOAAI
errMa, Qianpiao; Xu, Yang; Xu, Hongli; Jiang, Zhida; Huang, Liusheng; Huang, He
errShare
errSave
Blockchain-empowered Federated Learning: Challenges, Solutions, and Future Directions
err2023-02-22
err82
PREAI
errZhu, Juncen; Cao, Jiannong; Saxena, Divya; Jiang, Shan; Ferradi, Houda
errShare
errSave
Data-independent Random Projections from the feature-space of the homogeneous polynomial kernel
err2018-10-01
err7
errOAAI
errLopez-Sanchez, Daniel; Arrieta, Angelica Gonzalez; Corchado, Juan M.
errShare
errSave
researcher View more