.png){kind=icon}
Return
Optimizing data acquisition: a Bayesian approach for efficient machine learning model training
.png){kind=icon}
OA
AI
DOI：10.1088/2632-2153/ad605f.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Acquiring a substantial number of data points for training accurate machine learning (ML) models is a big challenge in scientific fields where data collection is resource-intensive. Here, we propose a novel approach for constructing a minimal yet highly informative database for training ML models in complex multi-dimensional parameter spaces. To achieve this, we mimic the underlying relation between the output and input parameters using Gaussian process regression (GPR). Using a set of known data, GPR provides predictive means and standard deviation for the unknown data. Given the predicted standard deviation by GPR, we select data points using Bayesian optimization to obtain an efficient database for training ML models. We compare the performance of ML models trained on databases obtained through this method, with databases obtained using traditional approaches. Our results demonstrate that the ML models trained on the database obtained using Bayesian optimization approach consistently outperform the other two databases, achieving high accuracy with a significantly smaller number of data points. Our work contributes to the resource-efficient collection of data in high-dimensional complex parameter spaces, to achieve high precision ML predictions.
Keywords:
machine learning
data acquisition
Bragg gratings
Bayesian optimization
FDTD simulations
inverse design
optimal data generation
Journal
M
IF:
4.6
Papers:
1.1K
Citations:
3.4K
Organization
Cited Papers
Taking the Human Out of the Loop: A Review of Bayesian Optimization.png)
PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
ShareSaveTraining of photonic neural networks through in situ backpropagation and gradient measurementOPTICA
OAAI
OPTICAIF8.5
OAAIShareSaveShareSaveIntelligent nanophotonics: merging photonics and artificial intelligence at the nanoscaleNANOPHOTONICSOAAI
NANOPHOTONICSIF6.6
OAAIShareSaveShareSaveShareSave
View more