.png){kind=icon}
Return
Gemini: Enabling Multi-Tenant GPU Sharing Based on Kernel Burst Estimation
.png){kind=icon}
PRE
AI
DOI：10.1109/TCC.2021.3119205.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Recent years have seen rapid adoption of GPUs in various types of platforms because of the tremendous throughput powered by massive parallelism. However, as the computing power of GPU continues to grow at a rapid pace, it also becomes harder to utilize these additional resources effectively with the support of GPU sharing. In this work, we designed and implemented Gemini, a user-space runtime scheduling framework to enable fine-grained GPU allocation control with support for multi-tenancy and elastic allocation, which are critical for cloud and resource providers. Our key idea is to introduce the concept of kernel burst, which refers to a group of consecutive kernels launched together without being interrupted by synchronous events. Based on the characteristics of kernel burst, we proposed a low overhead event-driven monitor and a dynamic time-sharing scheduler to achieve our goals. Our experiment evaluations using five types of GPU applications show that Gemini enabled multi-tenant and elastic GPU allocation with less than 5% performance overhead. Furthermore, compared to static scheduling, Gemini achieved 20%similar to 30% performance improvement without requiring prior knowledge of applications.
Keywords:
GPU
multi-tenancy
resource allocation
performance
scheduling
Journal
I
IF:
5
Papers:
1.9K
Citations:
4.3K
Organization
Cited Papers
Prevalence and Impact of Diabetes Mellitus in Adult Tuberculosis Patients;A Cross-Sectional Study
PREAI
ShareSave
ShareSaveShareSaveShareSaveThe early interaction between the Caribbean Plateau and the NW South American Plate.png)
Terra Nova
Terra NovaIF0
PREAI
ShareSave
View more