arrow
Return

IDDANet: An Input-Driven Dynamic Adaptive Network ensemble method for edge intelligence

delete2023-11-01
delete0
PRE
AI
Z
Zijia Mo
Z
Zhipeng Gao *
K
Kaile Xiao
C
Chen Zhao
X
Xinlei Yu
DOI:10.1016/j.future.2023.06.005delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Dynamic pruning and conditional convolution are crucial for reducing the computational complexity of convolutional neural networks, enabling their deployment on resource-limited devices. However, existing methods only focus on one aspect in isolation, ignoring the collaborative potential of devices and the similarity between input samples in edge cluster scenarios, making it difficult to eliminate redundancy in a given network structure. In order to reduce computation costs while enhancing model representation, we propose an input-driven dynamic adaptive network ensemble method, namely IDDANet. Our method is a two-stage model synthesis strategy that first dynamically prunes the network by using sample complexity and similarity to obtain a lightweight model and a set of inputdependent combination coefficients. We then combine the convolution parameters of multiple models to synthesize a more accurate ensemble model. As demonstrated through extensive experiments on different datasets, our method can significantly reduce computation complexity while improving model representation ability compared to state-of-the-art methods. For example, our method can reduce 58.5% of the FLOPs of ResNet-18, while only having a 0.1% Top-1 accuracy drop on CIFAR-10. & COPY; 2023 Elsevier B.V. All rights reserved.
Keywords:
Edge intelligence
Dynamic pruning
Conditional convolution
Efficient inference
Model compression
Artificial intelligence

Journal

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
Papers:
6.9K
Citations:
2.3W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9
B
Beijing Union University
Scholars:
1.1K
Papers: 893
Citations: 927
Cited Papers

Cited Papers

errShare
errSave
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
errShare
errSave
Rank-Constrained Spectral Clustering With Flexible Embedding
err2018-12-01
err217
PREAI
errLi, Zhihui; Nie, Feiping; Chang, Xiaojun; Nie, Liqiang; Zhang, Huaxiang; Yang, Yi
errShare
errSave
Dynamic Affinity Graph Construction for Spectral Clustering Using Multiple Features
err2018-12-01
err227
PREAI
errLi, Zhihui; Nie, Feiping; Chang, Xiaojun; Yang, Yi; Zhang, Chengqi; Sebe, Nicu
errShare
errSave
Person Reidentification via Multi-Feature Fusion With Adaptive Graph Learning
err2020-05-01
err130
PREAI
errZhou, Runwu; Chang, Xiaojun; Shi, Lei; Shen, Yi-Dong; Yang, Yi; Nie, Feiping
errShare
errSave
researcher View more