.png){kind=icon}
返回
Thermal-Aware on-Device Inference Using Single-Layer Parallelization with Heterogeneous Processors
.png){kind=icon}
OA
AI
DOI：10.26599/TST.2021.9010075.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Numerous neural network (NN) applications are now being deployed to mobile devices. These applications usually have large amounts of calculation and data while requiring low inference latency, which poses challenges to the computing ability of mobile devices. Moreover, devices' life and performance depend on temperature. Hence, in many scenarios, such as industrial production and automotive systems, where the environmental temperatures are usually high, it is important to control devices' temperatures to maintain steady operations. In this paper, we propose a thermal-aware channel-wise heterogeneous NN inference algorithm. It contains two parts, the thermal-aware dynamic frequency (TADF) algorithm and the heterogeneous-processor single-layer workload distribution (HSWD) algorithm. Depending on a mobile device's architecture characteristics and environmental temperature, TADF can adjust the appropriate running speed of the central processing unit and graphics processing unit, and then the workload of each layer in the NN model is distributed by HSWD in line with each processor's running speed and the characteristics of the layers as well as heterogeneous processors. The experimental results, where representative NNs and mobile devices were used, show that the proposed method can considerably improve the speed of the on-device inference by 21%-43% over the traditional inference method.
Keyword:
neural network inference
mobile device
temperature adjustment
channel-wise parallelization
期刊
T
IF:
3.5
论文数:
987
被引数:
2.5K
机构
引用论文
Structural study of lanthanides(III) in aqueous nitrate and chloride solutions by EXAFS通过EXAFS对硝酸盐和氯化物水溶液中镧系元素 (III) 的结构研究
PREAI
分享收藏Relationship Between Progressive Microvascular Damage and Intramyocardial Hemorrhage in Patients With Reperfused Anterior Myocardial Infarction.png)
Circulation
CirculationIF0
PREAI
分享收藏Energy-Efficient Resource Management for Federated Edge Learning With CPU-GPU Heterogeneous Computing通过cpu-gpu异构计算实现联合边缘学习的高能效资源管理OAAI
OAAI分享收藏
查看更多内容