Learning scalable dynamic filter in convolutional networks

Shuanglin Wu

doi:10.1016/j.patrec.2023.10.020

Learning scalable dynamic filter in convolutional networks

2023-12-01

1

PRE

AI

DOI：10.1016/j.patrec.2023.10.020

Original

Original request for help

Save

Abstract

En 中文

Most existing neural networks use static filters with fixed model capacity to process all samples. To cover the large variation among different samples, these networks contain considerable redundant computational budgets, thereby limiting their inference efficiency. To reduce these redundant computation for higher inference speed, in this paper, we propose a scalable dynamic filter that can customize its parameters and shapes conditioned on the input sample. Specifically, our scalable dynamic filter uses a kernel prediction head to predict dynamic kernels and employs a channel mask head to adaptively prune redundant channels. As a result, a kernel with dynamic parameters and an adaptive shape is produced for efficient inference. Extensive experiments on both image classification and object detection tasks demonstrate that our method achieves superior performance than previous methods with low computational complexity and high inference efficiency.

Keywords:

Dynamic network

Efficient inference

Image classification

Object detection

Learning scalable dynamic filter in convolutional networks

Abstract

Journal

Organization