arrow
返回

Distributed deep reinforcement learning for simulation control

delete2021-04-14
delete9
delete
OA
AI
S
Suraj Pawar
R
Romit Maulik *
DOI:10.1088/2632-2153/abdaf8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and computational expense. The tuning of these parameters is non-trivial and the general approach is to manually 'spot-check' for good combinations. This is because optimal hyperparameter configuration search becomes intractable when the parameter space is large and when they may vary dynamically. To address this issue, we present a framework based on deep reinforcement learning (RL) to train a deep neural network agent that controls a model solve by varying parameters dynamically. First, we validate our RL framework for the problem of controlling chaos in chaotic systems by dynamically changing the parameters of the system. Subsequently, we illustrate the capabilities of our framework for accelerating the convergence of a steady-state computational fluid dynamics solver by automatically adjusting the relaxation factors of the discretized Navier-Stokes equations during run-time. The results indicate that the run-time control of the relaxation factors by the learned policy leads to a significant reduction in the number of iterations for convergence compared to the random selection of the relaxation factors. Our results point to potential benefits for learning adaptive hyperparameter learning strategies across different geometries and boundary conditions with implications for reduced computational campaign expenses(4).
Keyword:
reinforcement learning
scientific machine learning
scientific computing

期刊

M
Machine Learning-Science and Technology
IF:
4.6
论文数:
1.1K
被引数:
3.4K

机构

O
oklahoma state university - stillwater
学者数:
4.4K
论文数: 3.8K
被引数: 4
O
oklahoma state university system
学者数:
8.2K
论文数: 7.3K
被引数: 6
引用论文

引用论文

err分享
err收藏
Serum analysis after transplant nephrectomy reveals restricted antibody specificity patterns against structurally defined HLA class I mismatches
err2005-03-01
err0
PREAI
errOyedele A. Adeyi; Alin L. Girnita; Judy Howe; Marilyn Marrari; Yehia Awadalla; Medhat Askar; Joan Martell; Adrian Zeevi; Ron Shapiro; Michael Nalesnik; Parmjeet Randhawa; Anthony J. Demetris; René J. Duquesnoy
err分享
err收藏
Machine Learning for Fluid Mechanics流体力学的机器学习
err2020-01-05
err1.7K
errOAAI
errBrunton, Steven L.; Noack, Bernd R.; Koumoutsakos, Petros
err分享
err收藏
Factors affecting parental intention to vaccinate kindergarten children against influenza: A cross-sectional survey in China
err2019-03-01
err0
PREAI
errYanbing Zeng; Zhipeng Yuan; Jiahui Yin; Yaofeng Han; Cheng-I. Chu; Ya Fang
err分享
err收藏
Superoxide dismutase
err1994-01-01
err0
PREAI
errE.R. James
err分享
err收藏
Turbulence Modeling in the Age of Data
err2019-01-05
err946
errOAAI
errDuraisamy, Karthik; Iaccarino, Gianluca; Xiao, Heng
err分享
err收藏
学者 查看更多内容