.png){kind=icon}
返回
Cooperative Distributed GPU Power Capping for Deep Learning Clusters
.png){kind=icon}
OA
AI
DOI：10.1109/TIE.2021.3095790.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The recent GPU-based clusters that handle deep learning (DL) tasks have the features of GPU device heterogeneity, a variety of deep neural network (DNN) models, and high computational complexity. Thus, the traditional power capping methods for CPU-based clusters or small-scale GPU devices cannot be applied to the GPU-based clusters handling DL tasks. This article develops a cooperative distributed GPU power capping (CD-GPC) system for GPU-based clusters, aiming to minimize the training completion time of invoked DL tasks without exceeding the limited power budget. Specifically, we first design the frequency scaling approach using the online model estimation based on the recursive least square method. This approach achieves the accurate tuning for DL task training time and power usage of GPU devices without needing offline profiling. Then, we formulate the proposed FS problem as a Lagrangian dual decomposition-based economic model predictive control problem for large-scale heterogeneous GPU clusters. We conduct both the NVIDIA GPU-based labscale real experiments and real job trace-based simulation experiments for performance evaluation. Experimental results validate that the proposed system improves the power capping accuracy to have a mean absolute error of <1%, and reduces the deadline violation ratio of invoked DL tasks by 21.5% compared with other recent counterparts.
Keyword:
Deep learning (DL) cluster
economic model predictive control (EMPC)
GPU power capping
Lagrangian dual decomposition
Lipschitz continuity
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.2
论文数:
1.8W
被引数:
9.8W
机构
引用论文
The role of solvent in the self-assembly of m-aminobenzoic acid: a density functional theory and molecular dynamics study.png)
CrystEngCommOAAI
CrystEngCommIF0
OAAI分享收藏Mosquitoes (Diptera: Culicidae) of Poland: An Update of Species Diversity and Current ChallengesInsects
OAAI
InsectsIF0
OAAI分享收藏
查看更多内容