.png){kind=icon}
.png){kind=icon}
Return
FairGV: Fair and Fast GPU Virtualization
.png){kind=icon}
OA
AI
DOI：10.1109/TPDS.2017.2717908.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Increasingly high performance computing (HPC) application developers are opting to use cloud resources due to higher availability. Virtualized GPUs would be an obvious and attractive option for HPC application developers using cloud hosting services. Unfortunately, existing GPU virtualization software is not ready to address fairness, utilization, and performance limitations associated with consolidating mixed HPC workloads. This paper presents FairGV, a radically redesigned GPU virtualization system that achieves system-wide weighted fair sharing and strong performance isolation in mixed workloads that use GPUs with variable degrees of intensity. To achieve its objectives, FairGV introduces a trap-less GPU processing architecture, a new fair queuing method integrated with work-conserving and GPU-centric coscheduling polices, and a collaborative scheduling method for non-preemptive GPUs. Our prototype implementation achieves near ideal fairness (>= 0.97 Min-Max Ratio) with little performance degradation (<= 1.02 aggregated overhead) in a range of mixed HPC workloads that leverage GPUs.
Keywords:
GPU virtualization
trap-less architecture
fair queuing
coscheduling and hybrid scheduling strategies
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6
Papers:
5.2K
Citations:
1.1W