arrow
Return

A new image classification method using CNN transfer learning and web data augmentation

delete2018-04-01
delete339
PRE
AI
D
Dongmei Han
Q
Qigang Liu *
W
Weiguo Fan
DOI:10.1016/j.eswa.2017.11.028delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Since Convolutional Neural Network (CNN) won the image classification competition 202 (ILSVRC12), a lot of attention has been paid to deep layer CNN study. The success of CNN is attributed to its superior multi-scale high-level image representations as opposed to hand-engineering low-level features. However, estimating millions of parameters of a deep CNN requires a large number of annotated samples, which currently prevents many superior deep CNNs (such as AlexNet, VGG, ResNet) being applied to problems with limited training data. To address this problem, a novel two-phase method combining CNN transfer learning and web data augmentation is proposed. With our method, the useful feature presentation of pre-trained network can be efficiently transferred to target task, and the original dataset can be augmented with the most valuable Internet images for classification. Our method not only greatly reduces the requirement of a large training data, but also effectively expand the training dataset. Both of method features contribute to the considerable over-fitting reduction of deep CNNs on small dataset. In addition, we successfully apply Bayesian optimization to solve the tuff problem, hyper-parameter tuning, in network fine-tuning. Our solution is applied to six public small datasets. Extensive experiments show that, comparing to traditional methods, our solution can assist the popular deep CNNs to achieve better performance. Particularly, ResNet can outperform all the state-of-the-art models on six small datasets. The experiment results prove that the proposed solution will be the great tool for dealing with practice problems which are related to use deep CNNs on small dataset. (C) 2017 Elsevier Ltd. All rights reserved.
Keywords:
Feature transferring
Data augmentation
Convolutional neural network
Feature representation
Parameter fine-tuning
Bayesian optimization

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

S
Shanghai University of Finance and Economics
Scholars:
2.0K
Papers: 2.5K
Citations: 4.0K
Cited Papers

Cited Papers

ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
Annealing effects of aluminum silicate films grown on Si(100)
err2002-05-07
err0
errOAAI
errM.-H. Cho; Y. S. Rho; H.-J. Choi; S. W. Nam; D.-H. Ko; J. H. Ku; H. C. Kang; D. Y. Noh; C. N. Whang; K. Jeong
errShare
errSave
BNC1 Promotes Spermatogenesis by Regulating Transcription of Ybx2 and Papolb via Direct Binding to Their Promotor Elements
err2020-11-19
err0
PREAI
errJing-Yi Li; Yan-Yun Ying; Yu-Li Qian; Jian-Peng Chen; Yun Huang; Juan Liu; Ping-Ping Lv; Yi-Feng Liu; Xiao-Ling Hu; Samantha L. P. Schilit; Jian-Zhong Sheng; He-Feng Huang; Dan Zhang
errShare
errSave
Learning Object Categories From Internet Image Searches
err2010-08-01
err59
errOAAI
errFergus, Rob; Fei-Fei, Li; Perona, Pietro; Zisserman, Andrew
errShare
errSave