arrow
返回

Dictionary-enabled efficient training of ConvNets for image classification

delete2023-07-01
delete4
PRE
AI
U
Usman Haider *
M
Muhammad Hanif
A
Ahmar Rashid
S
Syed Fawad Hussain
DOI:10.1016/j.imavis.2023.104718delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional networks (ConvNets) are computationally expensive but well known for their performance on image data. One way to reduce their complexity is to explore inherited data sparsity. However, since the gradi-ents involved in ConvNets require dynamic updates, applying data sparsity in the training step is not straightfor-ward. Dictionary-based learning methods can be useful since they encode the original data in a sparse form. This paper proposes a new dictionary-based training paradigm for ConvNets by exploiting redundancy in the training data while keeping the distinctive features intact. The ConvNet is then trained on the reduced, sparse dataset. The new approach significantly reduces the training time without compromising accuracy. To the best of our knowledge, this is the first implementation of ConvNet on dictionary-based sparse training data. The proposed method is validated on three publicly available datasets aeuroMNIST, USPS, and MNIST FASHION. The experimental results show a significant reduction of 4.5 times in the overall computational burden of vanilla ConvNet for all the datasets. Whereas the accuracy is intact at 97.21% for MNIST, 96.81% for USPS, and 88.4% for FASHION datasets. These results are comparable to state-of-the-art algorithms, such as ResNet-{18,34,50}, trained on the full training dataset.& COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Sparse representation
Convolution neural networks
Deep learning
Dictionary learning
Image classification

期刊

Image and Vision Computing 封面图
Image and Vision Computing
IF:
4.2
论文数:
4.1K
被引数:
6.7K

机构

G
gik institute engineering science & technology
学者数:
1.1K
论文数: 1.0K
被引数: 2
引用论文

引用论文

Graph Convolutional Networks for Hyperspectral Image Classification用于高光谱图像分类的图卷积网络
err2021-07-01
err1.3K
errOAAI
errHong, Danfeng; Gao, Lianru; Yao, Jing; Zhang, Bing; Plaza, Antonio; Chanussot, Jocelyn
err分享
err收藏
Dictionaries for Sparse Representation Modeling
err2010-06-01
err1.1K
PREAI
errRubinstein, Ron; Bruckstein, Alfred M.; Elad, Michael
err分享
err收藏
err分享
err收藏
Neural Importance Sampling
err2019-10-10
err180
errOAAI
errMueller, Thomas; Mcwilliams, Brian; Rousselle, Fabrice; Gross, Markus; Novak, Jan
err分享
err收藏
学者 查看更多内容