.png){kind=icon}
返回
Gemini: Enabling Multi-Tenant GPU Sharing Based on Kernel Burst Estimation
.png){kind=icon}
PRE
AI
DOI：10.1109/TCC.2021.3119205.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent years have seen rapid adoption of GPUs in various types of platforms because of the tremendous throughput powered by massive parallelism. However, as the computing power of GPU continues to grow at a rapid pace, it also becomes harder to utilize these additional resources effectively with the support of GPU sharing. In this work, we designed and implemented Gemini, a user-space runtime scheduling framework to enable fine-grained GPU allocation control with support for multi-tenancy and elastic allocation, which are critical for cloud and resource providers. Our key idea is to introduce the concept of kernel burst, which refers to a group of consecutive kernels launched together without being interrupted by synchronous events. Based on the characteristics of kernel burst, we proposed a low overhead event-driven monitor and a dynamic time-sharing scheduler to achieve our goals. Our experiment evaluations using five types of GPU applications show that Gemini enabled multi-tenant and elastic GPU allocation with less than 5% performance overhead. Furthermore, compared to static scheduling, Gemini achieved 20%similar to 30% performance improvement without requiring prior knowledge of applications.
Keyword:
GPU
multi-tenancy
resource allocation
performance
scheduling
期刊
I
IF:
5
论文数:
1.9K
被引数:
4.3K
机构
引用论文
Prevalence and Impact of Diabetes Mellitus in Adult Tuberculosis Patients;A Cross-Sectional Study
PREAI
分享收藏
The early interaction between the Caribbean Plateau and the NW South American Plate.png)
Terra Nova
Terra NovaIF0
PREAI
分享收藏vGASA: Adaptive Scheduling Algorithm of Virtualized GPU Resource in Cloud GamingvGASA: 云游戏中虚拟化GPU资源的自适应调度算法
PREAI
分享收藏
查看更多内容