arrow
返回

Multi-objective Reinforcement Learning for Responsive Grids

delete2010-06-08
delete14
PRE
AI
J
Julien Pérez
B
Balázs Kégl
C
Charles Loomis
DOI:10.1007/s10723-010-9161-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Grids organize resource sharing, a fundamental requirement of large scientific collaborations. Seamless integration of Grids into everyday use requires responsiveness, which can be provided by elastic Clouds, in the Infrastructure as a Service (IaaS) paradigm. This paper proposes a model-free resource provisioning strategy supporting both requirements. Provisioning is modeled as a continuous action-state space, multi-objective reinforcement learning (RL) problem, under realistic hypotheses; simple utility functions capture the high level goals of users, administrators, and shareholders. The model-free approach falls under the general program of autonomic computing, where the incremental learning of the value function associated with the RL model provides the so-called feedback loop. The RL model includes an approximation of the value function through an Echo State Network. Experimental validation on a real data-set from the EGEE Grid shows that introducing a moderate level of elasticity is critical to ensure a high level of user satisfaction.
Keyword:
Grid scheduling
Performance of systems
Machine learning
Reinforcement learning

期刊

Journal of Grid Computing 封面图
Journal of Grid Computing
IF:
2.9
论文数:
762
被引数:
1.2K

机构

C
centre national de la recherche scientifique (cnrs)
学者数:
24.5W
论文数: 18.2W
被引数: 279
U
Universite Paris Saclay
学者数:
7.3W
论文数: 5.3W
被引数: 540
引用论文

引用论文

Gas exchange at river cascades: field experiments and model calculations
err2002-05-01
err0
PREAI
errOlaf Cirpka; Peter Reichert; Oskar Wanner; Stephan R. Mueller; Rene P. Schwarzenbach
err分享
err收藏
Laser Stabilisation for the Measurement of Thermal Noise
err2000-03-01
err0
PREAI
errK. G. Baigent; D. A. Shaddock; M. B. Gray; D. E. McClelland
err分享
err收藏
Modeling of low-bandgap solar cells for thermophotovoltaic applications
err1995-01-01
err0
PREAI
errRaj K. Jain; David M. Wilt; Geoffrey A. Landis; Rakesh Jain; Irving Weinberg; Dennis J. Flood
err分享
err收藏
The Convergence of Clouds, Grids, and Autonomics
err2009-11-01
err15
PREAI
errGermain-Renaud, Cecile; Rana, Omer F.
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Three Bromides of Lanthanum: LaBr2, La2Br5, and LaBr3
err2004-11-09
err0
PREAI
errKarl Krämer; Thomas Schleid; Mathias Schulze; Werner Urland; Gerd Meyer
err分享
err收藏
学者 查看更多内容