.png){kind=icon}
返回
DRLCAP: Runtime GPU Frequency Capping With Deep Reinforcement Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TSUSC.2024.3362697.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Power and energy consumption is the limiting factor of modern computing systems. As the GPU becomes a mainstream computing device, power management for GPUs becomes increasingly important. Current works focus on GPU kernel-level power management, with challenges in portability due to architecture-specific considerations. We present DRLCap, a general runtime power management framework intended to support power management across various GPU architectures. It periodically monitors system-level information to dynamically detect program phase changes and model the workload and GPU system behavior. This elimination from kernel-specific constraints enhances adaptability and responsiveness. The framework leverages dynamic GPU frequency capping, which is the most widely used power knob, to control the power consumption. DRLCap employs deep reinforcement learning (DRL) to adapt to the changing of program phases by automatically adjusting its power policy through online learning, aiming to reduce the GPU power consumption without significantly compromising the application performance. We evaluate DRLCap on three NVIDIA and one AMD GPU architectures. Experimental results show that DRLCap improves prior GPU power optimization strategies by a large margin. On average, it reduces the GPU energy consumption by 22% with less than 3% performance slowdown on NVIDIA GPUs. This translates to a 20% improvement in the energy efficiency measured by the energy-delay product (EDP) over the NVIDIA default GPU power management strategy. For the AMD GPU architecture, DRLCap saves energy consumption by 10%, on average, with a 4% percentage loss, and improves energy efficiency by 8%.
Keyword:
Graphics processing units
Computer architecture
Optimization
Power system management
Runtime
Kernel
Deep learning
Deep reinforcement learning
GPU power optimization
GPUs
power and energy optimization
期刊
I
IF:
5
论文数:
1.9K
被引数:
4.3K
机构
引用论文
A new trans-Andean Stick Catfish of the genus Farlowella Eigenmann & Eigenmann, 1889 (Siluriformes: Loricariidae) with the first record of the genus for the río Magdalena Basin in Colombia一种新发现的跨安第斯棒状鲶鱼，属于Farlowella Eigenmann & Eigenmann, 1889属（Siluriformes目：Loricariidae科），也是该属鱼类在哥伦比亚马格达莱纳河流域的首个记录。.png)
Zootaxa
ZootaxaIF0
PREAI
分享收藏
分享收藏
查看更多内容