arrow
返回

IDDANet: An Input-Driven Dynamic Adaptive Network ensemble method for edge intelligence

delete2023-11-01
delete0
PRE
AI
Z
Zijia Mo
Z
Zhipeng Gao *
K
Kaile Xiao
C
Chen Zhao
X
Xinlei Yu
DOI:10.1016/j.future.2023.06.005delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Dynamic pruning and conditional convolution are crucial for reducing the computational complexity of convolutional neural networks, enabling their deployment on resource-limited devices. However, existing methods only focus on one aspect in isolation, ignoring the collaborative potential of devices and the similarity between input samples in edge cluster scenarios, making it difficult to eliminate redundancy in a given network structure. In order to reduce computation costs while enhancing model representation, we propose an input-driven dynamic adaptive network ensemble method, namely IDDANet. Our method is a two-stage model synthesis strategy that first dynamically prunes the network by using sample complexity and similarity to obtain a lightweight model and a set of inputdependent combination coefficients. We then combine the convolution parameters of multiple models to synthesize a more accurate ensemble model. As demonstrated through extensive experiments on different datasets, our method can significantly reduce computation complexity while improving model representation ability compared to state-of-the-art methods. For example, our method can reduce 58.5% of the FLOPs of ResNet-18, while only having a 0.1% Top-1 accuracy drop on CIFAR-10. & COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Edge intelligence
Dynamic pruning
Conditional convolution
Efficient inference
Model compression
Artificial intelligence

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.8K
被引数:
2.3W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
B
Beijing Union University
学者数:
1.1K
论文数: 893
被引数: 927
引用论文

引用论文

Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
err分享
err收藏
Rank-Constrained Spectral Clustering With Flexible Embedding
err2018-12-01
err217
PREAI
errLi, Zhihui; Nie, Feiping; Chang, Xiaojun; Nie, Liqiang; Zhang, Huaxiang; Yang, Yi
err分享
err收藏
Dynamic Affinity Graph Construction for Spectral Clustering Using Multiple Features
err2018-12-01
err227
PREAI
errLi, Zhihui; Nie, Feiping; Chang, Xiaojun; Yang, Yi; Zhang, Chengqi; Sebe, Nicu
err分享
err收藏
学者 查看更多内容