Distributed simulation optimization and parameter exploration framework for the cloud

Michele Carillo

doi:10.1016/j.simpat.2017.12.005

Return

Distributed simulation optimization and parameter exploration framework for the cloud

2018-04-01

PRE

DOI：10.1016/j.simpat.2017.12.005

Original

Save

Abstract

En 中文

Simulation models are becoming an increasingly popular tool for the analysis and optimization of complex real systems in different fields. Finding an optimal system design requires performing a large sweep over the parameter space in an organized way. Hence, the model optimization process is extremely demanding from a computational point of view, as it requires careful, time-consuming, complex orchestration of coordinated executions. In this paper, we present the design of SOF (Simulation Optimization and exploration Framework in the cloud), a framework which exploits the computing power of a cloud computational environment in order to carry out effective and efficient simulation optimization strategies. SOF offers several attractive features. Firstly, SOF requires zero configuration, as it does not require any additional software installed on the remote node; only standard Apache Hadoop and SSH access are sufficient. Secondly, SOF is transparent to the user, since the user is totally unaware that the system operates on a distributed environment. Finally, SOF is highly customizable and programmable, since it enables the running of different simulation optimization scenarios using diverse programming languages - provided that the hosting platform supports them - and different simulation toolkits, as developed by the modeler. The tool has been fully developed and is available on a public repository 1 under the terms of the open source Apache License. It has been tested and validated on several private platforms, such as a dedicated cluster of workstations, as well as on public platforms, including the Hortonworks Data Platform and Amazon Web Services Elastic MapReduce solution. (C) 2017 Elsevier B.V. All rights reserved.

Keywords:

Agent-based simulation

Parallel computing

Distributed computing

Simulation optimization

Model exploration

Cloud computing