arrow
Return

MXGPU: A Case Study on OS-Controlled GPGPU Multiplexing

delete2026-01-01
delete0
PRE
AI
M
Marcel Lütke Dreimann *
O
Olaf Spinczyk
DOI:10.1007/978-3-032-03281-2_6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the growing demand for artificial intelligence and other data-intensive applications, the demand for graphics processing units (GPUs) has also increased. Even though there are many approaches on multiplexing GPUs, none of the approaches known to us enable the operating system to coherently integrate GPU resources alongside CPU resources into a holistic resource management. Due to the history of GPUs, GPU drivers are still a large, isolated part within the driver stack of operating systems. This paper aims to conduct a case study on how a multiplexing solution for GPGPUs could look like, where the OS is able to define scheduling policies for GPGPU tasks and manage GPU memory. We will discuss the architecture of MxGPU, which offers software-based multiplexing of integrated Intel GPUs. MxGPU has a tiny code base, which is a precondition for formal verification approaches and usage in safety-critical environments. Experiments with our prototype show that MxGPU can grant the operating system control over GPU resources while allowing more GPU sessions with less overhead compared to existing work.
Keywords:
GPGPU
Multiplexing
Resource Management
Operating System

Journal

A
ARCHITECTURE OF COMPUTING SYSTEMS, ARCS 2025
IF:
0
Papers:
35
Citations:
0

Organization

U
University Osnabruck
Scholars:
3.0K
Papers: 2.6K
Citations: 15
Cited Papers

Cited Papers

errShare
errSave
FairGV: Fair and Fast GPU Virtualization
err2017-12-01
err27
errOAAI
errHong, Cheol-Ho; Spence, Ivor; Nikolopoulos, Dimitrios S.
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Enabling CUDA acceleration within virtual machines using rCUDA
err2011-12-01
err0
errOAAI
errJose Duato; Antonio J. Pena; Federico Silla; Juan C. Fernandez; Rafael Mayo; Enrique S. Quintana-Orti
errShare
errSave
GPU-based Pedestrian Detection for Autonomous Driving
err2016-01-01
err0
errOAAI
errV. Campmany; S. Silva; A. Espinosa; J.C. Moure; D. Vázquez; A.M. López
errShare
errSave
GPU Virtualization and Scheduling Methods: A Comprehensive Survey
err2017-06-29
err70
errOAAI
errHong, Cheol-Ho; Spence, Ivor; Nikolopoulos, Dimitrios S.
errShare
errSave
gRemote: API-Forwarding Powered Cloud Rendering
err2020-06-23
err0
PREAI
errDongjie Tang; Yun Wang; Linsheng Li; Jiacheng Ma; Xue Liu; Zhengwei Qi; Haibing Guan
errShare
errSave
Auto-tuning a high-level language targeted to GPU codes
err2012-05-01
err0
errOAAI
errScott Grauer-Gray; Lifan Xu; Robert Searles; Sudhee Ayalasomayajula; John Cavazos
errShare
errSave
AI-Enabling Workloads on Large-Scale GPU-Accelerated System: Characterization, Opportunities, and Implications
err2022-04-01
err0
PREAI
errBaolin Li; Rohin Arora; Siddharth Samsi; Tirthak Patel; William Arcand; David Bestor; Chansup Byun; Rohan Basu Roy; Bill Bergeron; John Holodnak; Michael Houle; Matthew Hubbell; Michael Jones; Jeremy Kepner; Anna Klein; Peter Michaleas; Joseph McDonald; Lauren Milechin; Julie Mullen; Andrew Prout; Benjamin Price; Albert Reuther; Antonio Rosa; Matthew Weiss; Charles Yee; Daniel Edelman; Allan Vanterpool; Anson Cheng; Vijay Gadepally; Devesh Tiwari
errShare
errSave
researcher View more