arrow
返回

Optimizing data acquisition: a Bayesian approach for efficient machine learning model training

delete2024-07-17
delete1
delete
OA
AI
M
M. R. Mahani *
I
Igor A. Nechepurenko
Y
Yasmin Rahimof
A
Andreas Wicht
DOI:10.1088/2632-2153/ad605fdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Acquiring a substantial number of data points for training accurate machine learning (ML) models is a big challenge in scientific fields where data collection is resource-intensive. Here, we propose a novel approach for constructing a minimal yet highly informative database for training ML models in complex multi-dimensional parameter spaces. To achieve this, we mimic the underlying relation between the output and input parameters using Gaussian process regression (GPR). Using a set of known data, GPR provides predictive means and standard deviation for the unknown data. Given the predicted standard deviation by GPR, we select data points using Bayesian optimization to obtain an efficient database for training ML models. We compare the performance of ML models trained on databases obtained through this method, with databases obtained using traditional approaches. Our results demonstrate that the ML models trained on the database obtained using Bayesian optimization approach consistently outperform the other two databases, achieving high accuracy with a significantly smaller number of data points. Our work contributes to the resource-efficient collection of data in high-dimensional complex parameter spaces, to achieve high precision ML predictions.
Keyword:
machine learning
data acquisition
Bragg gratings
Bayesian optimization
FDTD simulations
inverse design
optimal data generation

期刊

M
Machine Learning-Science and Technology
IF:
4.6
论文数:
1.1K
被引数:
3.4K

机构

L
Leibniz Association
学者数:
3.4W
论文数: 3.1W
被引数: 64
引用论文

引用论文

Isolation and characterization of the nematophagous fungus Arthrobotrys conoides
err2012-09-20
err0
PREAI
errMargarete Kimie Falbo; Vanete Thomaz Soccol; Itacir Eloi Sandini; Vânia Aparecida Vicente; Diogo Robl; Carlos Ricardo Soccol
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
err分享
err收藏
Space-borne frequency comb metrology
errOPTICA
IF8.5
err2016-11-17
err232
errOAAI
errLezius, Matthias; Wilken, Tobias; Deutsch, Christian; Giunta, Michele; Mandel, Olaf; Thaller, Andy; Schkolnik, Vladimir; Schiemangk, Max; Dinkelaker, Aline; Kohfeldt, Anja; Wicht, Andreas; Krutzik, Markus; Peters, Achim; Hellmig, Ortwin; Duncker, Hannes; Sengstock, Klaus; Windpassinger, Patrick; Lampmann, Kai; Huelsing, Thomas; Haensch, Theodor W.; Holzwarth, Ronald
err分享
err收藏
Deep learning for accelerated all-dielectric metasurface design用于加速全电介质超表面设计的深度学习
err2019-09-16
err352
errOAAI
errNadell, Christian C.; Huang, Bohao; Malof, Jordan M.; Padilla, Willie J.
err分享
err收藏
学者 查看更多内容