arrow
Return

Prediction-based GPU Sharing for Distributed Training

delete2026-02-03
delete0
delete
OA
AI
C
Changyong Shin
Y
Younghun Go
Y
Yeonho Yoo
J
Jinwoo Jeong
J
Jaehyun Hwang
G
Gyeongsik Yang
C
Chuck Yoo
DOI:10.1016/j.future.2026.108413delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
• Formulate the inconsistent JCT problem using gSLA for the first time. • Design a new JCT increase prediction model and job scheduler for GPU sharing. • Achieve up to 47.3× better gSLA satisfaction and 50× lower gSLA excess ratio. • Improve JCT and GPU efficiency by  ∼ 60% and  ∼ 44% over existing methods. • Demonstrate TensorShare’s effectiveness in improving gSLA and JCT for unseen jobs.
Keywords:
Cloud computing
GPU sharing
Service level agreement
Performance prediction
GPU scheduling
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

F
Future Generation Computer Systems
IF:
0
Papers:
642
Citations:
0

Organization

K
Korea University
Scholars:
3.6W
Papers: 3.8W
Citations: 4.4W
S
Sungkyunkwan University
Scholars:
2.8K
Papers: 1.1K
Citations: 2
D
Dongguk University
Scholars:
8.2K
Papers: 9.3K
Citations: 1.0W
researcher View more organizations
Cited Papers

Cited Papers

FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline
err2023-03-06
err0
PREAI
errTaegeon Um; Byungsoo Oh; Byeongchan Seo; Minhyeok Kweun; Goeun Kim; Woo-Yeon Lee
errShare
errSave
Another look at measures of forecast accuracy
err2006-10-01
err3.4K
errOAAI
errHyndman, Rob J.; Koehler, Anne B.
errShare
errSave
Horus: Interference-Aware and Prediction-Based Scheduling in Deep Learning Systems
err2022-01-01
err47
errOAAI
errYeung, Gingfung; Borowiec, Damian; Yang, Renyu; Friday, Adrian; Harper, Richard; Garraghan, Peter
errShare
errSave
Moneo
err2022-06-14
err0
PREAI
errJiang,Yuting; Xiong,Yifan; Qu,Lei; Luo,Cheng Luo; Tian,Chen; Cheng,Peng; Xiong,Yongqiang
errShare
errSave
Silo
err2015-08-17
err0
PREAI
errKeon Jang; Justine Sherry; Hitesh Ballani; Toby Moncaster
errShare
errSave
ImageNet Classification with Deep Convolutional Neural Networks
err2017-05-24
err8.3W
errOAAI
errKrizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E.
errShare
errSave
A survey of deep learning techniques for autonomous driving
err2019-11-14
err1.0K
errOAAI
errGrigorescu, Sorin; Trasnea, Bogdan; Cocias, Tiberiu; Macesanu, Gigel
errShare
errSave
Towards predictable datacenter networks
err2011-08-15
err0
PREAI
errHitesh Ballani; Paolo Costa; Thomas Karagiannis; Ant Rowstron
errShare
errSave
researcher View more