arrow
Return

Practicable live container migrations in high performance computing clouds: Diskless, iterative, and connection-persistent

delete2024-07-01
delete2
delete
OA
AI
J
Jordi Guitart *
DOI:10.1016/j.sysarc.2024.103157delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Checkpoint/Restore techniques had been thoroughly used by the High Performance Computing (HPC) community in the context of failure recovery. Given the current trend in HPC to use containerization to obtain fast, customized, portable, flexible, and reproducible deployments of their workloads, as well as efficient and reliable sharing and management of HPC Cloud infrastructures, there is a need to integrate Checkpoint/Restore with containerization in such a way that the freeze time of the application is minimal and live migrations are practicable. Whereas current Checkpoint/Restore tools (such as CRIU) support several options to accomplish this, most of them are rarely exploited in HPC Clouds and, consequently, their potential impact on the performance is barely known. Therefore, this paper explores the use of CRIU's advanced features to implement diskless, iterative (pre-copy and post-copy) migrations of containers with external network namespaces and established TCP connections, so that memory-intensive and connection-persistent HPC applications can livemigrate. Our extensive experiments to characterize the performance impact of those features demonstrate that properly-configured live migrations incur low application downtime and memory/disk usage and are indeed feasible in containerized HPC Clouds.
Keywords:
Checkpoint/restore
Live migration
Diskless migration
Iterative migration
Networking migration
CRIU
RunC
Containerization
HPC cloud
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Systems Architecture cover
Journal of Systems Architecture
IF:
4.1
Papers:
3.0K
Citations:
4.2K

Organization

U
universitat politecnica de catalunya
Scholars:
1.9W
Papers: 1.6W
Citations: 17
Cited Papers

Cited Papers

A survey of rollback-recovery protocols in message-passing systems
err2002-09-01
err988
errOAAI
errElnozahy, EN; Alvisi, L; Wang, YM; Johnson, DB
errShare
errSave
Big data and extreme-scale computing: Pathways to Convergence-Toward a shaping strategy for a future software and data ecosystem for scientific inquiry
err2018-07-16
err79
PREAI
errAsch, M.; Moore, T.; Badia, R.; Beck, M.; Beckman, P.; Bidot, T.; Bodin, F.; Cappello, F.; Choudhary, A.; de Supinski, B.; Deelman, E.; Dongarra, J.; Dubey, A.; Fox, G.; Fu, H.; Girona, S.; Gropp, W.; Heroux, M.; Ishikawa, Y.; Keahey, K.; Keyes, D.; Kramer, W.; Lavignon, J-F; Lu, Y.; Matsuoka, S.; Mohr, B.; Reed, D.; Requena, S.; Saltz, J.; Schulthess, T.; Stevens, R.; Swany, M.; Szalay, A.; Tang, W.; Varoquaux, G.; Vilotte, J-P; Wisniewski, R.; Xu, Z.; Zacharov, I.
errShare
errSave
HPC Cloud for Scientific and Business Applications: Taxonomy, Vision, and Research Challenges
err2018-01-04
err103
errOAAI
errNetto, Marco A. S.; Calheiros, Rodrigo N.; Rodrigues, Eduardo R.; Cunha, Renato L. F.; Buyya, Rajkumar
errShare
errSave
Container Migration in the Fog: A Performance Evaluation
errSENSORS
IF3.5
err2019-03-27
err74
errOAAI
errPuliafito, Carlo; Vallati, Carlo; Mingozzi, Enzo; Merlino, Giovanni; Longo, Francesco; Puliafito, Antonio
errShare
errSave
no more