返回
IDDANet: An Input-Driven Dynamic Adaptive Network ensemble method for edge intelligence
DOI:10.1016/j.future.2023.06.005.png)
摘要
En 中文
Dynamic pruning and conditional convolution are crucial for reducing the computational complexity of convolutional neural networks, enabling their deployment on resource-limited devices. However, existing methods only focus on one aspect in isolation, ignoring the collaborative potential of devices and the similarity between input samples in edge cluster scenarios, making it difficult to eliminate redundancy in a given network structure. In order to reduce computation costs while enhancing model representation, we propose an input-driven dynamic adaptive network ensemble method, namely IDDANet. Our method is a two-stage model synthesis strategy that first dynamically prunes the network by using sample complexity and similarity to obtain a lightweight model and a set of inputdependent combination coefficients. We then combine the convolution parameters of multiple models to synthesize a more accurate ensemble model. As demonstrated through extensive experiments on different datasets, our method can significantly reduce computation complexity while improving model representation ability compared to state-of-the-art methods. For example, our method can reduce 58.5% of the FLOPs of ResNet-18, while only having a 0.1% Top-1 accuracy drop on CIFAR-10. & COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Edge intelligence
Dynamic pruning
Conditional convolution
Efficient inference
Model compression
Artificial intelligence
期刊
F
IF:
6.1
论文数:
6.8K
被引数:
2.3W
机构
引用论文
The power of obfuscation techniques in malicious JavaScript code: A measurement study恶意JavaScript代码中混淆技术的功能: 一项测量研究

