返回
Dictionary-enabled efficient training of ConvNets for image classification
DOI:10.1016/j.imavis.2023.104718.png)
摘要
En 中文
Convolutional networks (ConvNets) are computationally expensive but well known for their performance on image data. One way to reduce their complexity is to explore inherited data sparsity. However, since the gradi-ents involved in ConvNets require dynamic updates, applying data sparsity in the training step is not straightfor-ward. Dictionary-based learning methods can be useful since they encode the original data in a sparse form. This paper proposes a new dictionary-based training paradigm for ConvNets by exploiting redundancy in the training data while keeping the distinctive features intact. The ConvNet is then trained on the reduced, sparse dataset. The new approach significantly reduces the training time without compromising accuracy. To the best of our knowledge, this is the first implementation of ConvNet on dictionary-based sparse training data. The proposed method is validated on three publicly available datasets aeuroMNIST, USPS, and MNIST FASHION. The experimental results show a significant reduction of 4.5 times in the overall computational burden of vanilla ConvNet for all the datasets. Whereas the accuracy is intact at 97.21% for MNIST, 96.81% for USPS, and 88.4% for FASHION datasets. These results are comparable to state-of-the-art algorithms, such as ResNet-{18,34,50}, trained on the full training dataset.& COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Sparse representation
Convolution neural networks
Deep learning
Dictionary learning
Image classification
期刊
IF:
4.2
论文数:
4.1K
被引数:
6.7K
机构
引用论文
Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network基于深度卷积神经网络的间质性肺疾病肺模式分类

