arrow
返回

Target-Aware Neural Network Execution via Compiler-Guided Pruning

delete2025-11-11
delete0
PRE
AI
J
JooHyoung Cha
T
Taeho Kim
J
Jemin Lee
S
Sangtae Ha
Y
Yongin Kwon
DOI:10.1109/TMC.2025.3631673delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
移动设备为各种目的运行深度学习模型,例如图像分类和语音识别。由于移动设备的资源限制,研究人员专注于使用模型剪枝来构建轻量级深度神经网络(DNN)模型,或通过编译器优化生成高效代码。观察到模型压缩与编译器自调优的直接集成往往无法为目标设备产生最高效的模型。我们提出CPrune,一种面向高效目标感知DNN执行的编译器指导模型剪枝,以支持具有所需目标精度的应用。为解决具有资源或延迟约束的实际部署场景,我们进一步引入RB-CPrune,一种预测性变体,通过使用学习的延迟估计器消除迭代调优。CPrune通过基于编译器调优过程中构建的子图结构信息进行指导剪枝,生成轻量级DNN模型。我们的实验结果表明,与当前最优的TVM自调优相比,CPrune将DNN执行速度提升了最高2.73倍,同时满足精度要求。
Keyword:
Deep neural networks
model pruning
compiler optimization
edge ai
latency estimation
resource-aware inference
predictive pruning

期刊

IEEE Transactions on Mobile Computing 封面图
IEEE Transactions on Mobile Computing
IF:
9.2
论文数:
5.8K
被引数:
1.8W

机构

U
university of colorado
学者数:
2.8K
论文数: 1.4K
被引数: 0
E
electronics and telecommunications research institute
学者数:
104
论文数: 53
被引数: 0
A
amazon web services
学者数:
22
论文数: 14
被引数: 0
U
university of science and technology
学者数:
344
论文数: 163
被引数: 0
学者 查看更多机构
引用论文

引用论文

FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search
err2019-06-01
err0
errOAAI
errBichen Wu; Kurt Keutzer; Xiaoliang Dai; Peizhao Zhang; Yanghan Wang; Fei Sun; Yiming Wu; Yuandong Tian; Peter Vajda; Yangqing Jia
err分享
err收藏
err分享
err收藏
Machine Learning-Based Malicious Application Detection of Android基于机器学习的Android恶意应用检测
err2017-01-01
err49
errOAAI
errWei, Linfeng; Luo, Weiqi; Weng, Jian; Zhong, Yanjun; zhang, Xiaoqian; Yan, Zheng
err分享
err收藏
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
err2018-10-06
err0
PREAI
errYihui He; Ji Lin; Zhijian Liu; Hanrui Wang; Li-Jia Li; Song Han
err分享
err收藏
Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾
err2016-01-01
err3.5K
PREAI
errShahriari, Bobak; Swersky, Kevin; Wang, Ziyu; Adams, Ryan P.; de Freitas, Nando
err分享
err收藏
Epileptic Seizure Detection and Experimental Treatment: A Review癫痫发作的检测和实验治疗: 综述
err2020-07-21
err0
errOAAI
errTaeho Kim; Phuc Nguyen; Nhat Pham; Nam Bui; Hoang Truong; Sangtae Ha; Tam Vu
err分享
err收藏
Permute, Quantize, and Fine-tune: Efficient Compression of Neural Networks
err2021-06-01
err0
errOAAI
errJulieta Martinez; Jashan Shewakramani; Ting Wei Liu; Ioan Andrei Barsan; Wenyuan Zeng; Raquel Urtasun
err分享
err收藏
学者 查看更多内容