arrow
返回

Model-Free GPU Online Energy Optimization

delete2024-03-01
delete0
PRE
AI
F
Farui Wang
M
Meng Hao
张
张伟哲 (Weizhe Zhang) *
Z
Zheng Wang
DOI:10.1109/TSUSC.2023.3314916delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
GPUs play a central and indispensable role as accelerators in modern high-performance computing (HPC) platforms, enabling a wide range of tasks to be performed efficiently. However, the use of GPUs also results in significant energy consumption and carbon dioxide (CO2) emissions. This article presents MF-GPOEO, a model-free GPU online energy efficiency optimization framework. MF-GPOEO leverages a synthetic performance index and a PID controller to dynamically determine the optimal clock frequency configuration for GPUs. It profiles GPU kernel activity information under different frequency configurations and then compares GPU kernel execution time and gap duration between kernels to derive the synthetic performance index. With the performance index and measured average power, MF-GPOEO can use the PID controller to try different frequency configurations and find the optimal frequency configuration under the guidance of user-defined objective functions. We evaluate the MF-GPOEO by running it with 74 applications on an NVIDIA RTX3080Ti GPU. MF-GPOEO delivers a mean energy saving of 26.2% with a slight average execution time increase of 3.4% compared with NVIDIA's default clock scheduling strategy.
Keyword:
GPU
DVFS
performance evaluation
energy efficiency optimization

期刊

I
IEEE Transactions on Cloud Computing
IF:
5
论文数:
1.8K
被引数:
4.3K

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
U
university of leeds
学者数:
3.6W
论文数: 3.3W
被引数: 45
引用论文

引用论文

A Survey of Power and Energy Predictive Models in HPC Systems and ApplicationsHPC系统和应用中的功率和能量预测模型综述
err2017-06-29
err52
PREAI
errO'Brien, Kenneth; Pietri, Ilia; Reddy, Ravi; Lastovetsky, Alexey; Sakellariou, Rizos
err分享
err收藏
Interaction of laser-cooled87Rb atoms with higher order modes of an optical nanofibre
err2015-01-15
err0
errOAAI
errRavi Kumar; Vandna Gokhroo; Kieran Deasy; Aili Maimaiti; Mary C Frawley; Ciarán Phelan; Síle Nic Chormaic
err分享
err收藏
A Survey of Low-Energy Parallel Scheduling Algorithms
err2022-01-01
err37
PREAI
errXie, Guoqi; Xiao, Xiongren; Peng, Hao; Li, Renfa; Li, Keqin
err分享
err收藏
GPU Static Modeling Using PTX and Deep Structured Learning
err2019-01-01
err17
errOAAI
errGuerreiro, Joao; Ilic, Aleksandar; Roma, Nuno; Tomas, Pedro
err分享
err收藏
QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials量子浓缩咖啡: 用于材料量子模拟的模块化开源软件项目
err2009-09-01
err0
errOAAI
errPaolo Giannozzi; Stefano Baroni; Nicola Bonini; Matteo Calandra; Roberto Car; Carlo Cavazzoni; Davide Ceresoli; Guido L Chiarotti; Matteo Cococcioni; Ismaila Dabo; Andrea Dal Corso; Stefano de Gironcoli; Stefano Fabris; Guido Fratesi; Ralph Gebauer; Uwe Gerstmann; Christos Gougoussis; Anton Kokalj; Michele Lazzeri; Layla Martin-Samos; Nicola Marzari; Francesco Mauri; Riccardo Mazzarello; Stefano Paolini; Alfredo Pasquarello; Lorenzo Paulatto; Carlo Sbraccia; Sandro Scandolo; Gabriele Sclauzero; Ari P Seitsonen; Alexander Smogunov; Paolo Umari; Renata M Wentzcovitch
err分享
err收藏
学者 查看更多内容