ESCAN: Efficient GPU sharing for cascade neural network inference

Wang, Jianan

doi:10.1016/j.neunet.2025.107703

2025-06-15

PRE

DOI：10.1016/j.neunet.2025.107703

原文链接

原文求助

摘要

En 中文

• 我们探讨了级联模型在GPU共享场景下的部署挑战。 • GPU共享需要平衡级联模型的并行收益和冗余计算。 • 我们引入了带有批处理并行执行和资源分配的ESCAN。 • ESCAN通过优化执行模式和资源分配提高了级联模型的效率。 • ESCAN简化并增强了优化过程的效率。

期刊

Neural Networks

IF:

6.3

论文数:

8.2K

被引数:

3.0W

机构

暂无机构信息

引用论文

Deep Neural Decision Forests

2015 IEEE International Conference on Computer Vision (ICCV)

IF0

2015-12-01

PREAI

Peter Kontschieder; Madalina Fiterau; Antonio Criminisi; Samuel Rota Bulo

Resolution Adaptive Networks for Efficient Inference

2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

IF0

2020-06-01

OAAI

Le Yang; Yizeng Han; Xi Chen; Shiji Song; Jifeng Dai; Gao Huang

Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-Offs by Selective Execution

Proceedings of the AAAI Conference on Artificial Intelligence

IF0

2018-04-29

OAAI

Lanlan Liu; Jia Deng

Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges 深度学习应用的拆分计算和早期退出: 调查和研究挑战

ACM COMPUTING SURVEYS

IF28

2022-12-03

OAAI

Matsubara, Yoshitomo; Levorato, Marco; Restuccia, Francesco

Dynamic Neural Networks: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence

IF0

2022-11-01

OAAI

Yizeng Han; Gao Huang; Shiji Song; Le Yang; Honghui Wang; Yulin Wang

Roofline: An Insightful Visual Performance Model for Multicore Architectures

COMMUNICATIONS OF THE ACM

IF12.2

2009-04-01

1.6K

OAAI

Williams, Samuel; Waterman, Andrew; Patterson, David

Densely Connected Convolutional Networks 密集连接的卷积网络

2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

IF0

2017-07-01

OAAI

Gao Huang; Zhuang Liu; Laurens Van Der Maaten; Kilian Q. Weinberger

Pixel-Adaptive Convolutional Neural Networks

2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

IF0

2019-06-01

OAAI

Hang Su; Varun Jampani; Deqing Sun; Orazio Gallo; Erik Learned-Miller; Jan Kautz

Locality-based warp scheduling in GPGPUs Gpgpu中基于位置的warp调度

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE

IF6.1

2018-05-01

PREAI

Zhang, Yang; Xing, Zuochen; Liu, Cang; Tang, Chuan; wang, Qinglin

Segmentation-Aware Convolutional Networks Using Local Attention Masks

2017 IEEE International Conference on Computer Vision (ICCV)

IF0

2017-10-01

OAAI

Adam W. Harley; Konstantinos G. Derpanis; Iasonas Kokkinos

查看更多内容