arrow
Return

Sequence-Dropout Block for Reducing Overfitting Problem in Image Classification

delete2020-01-01
delete32
delete
OA
AI
L
Ledan Qian
L
Libing Hu *
L
Li Zhao *
T
Tao Wang
蒋润花 cover
蒋润花 (Runhua Jiang)
DOI:10.1109/ACCESS.2020.2983774delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Overfitting is a common problem for computer vision applications It is a problem that when training convolution neural networks and is caused by lack of training data or network complexity. The novel sequence-dropout (SD) method is proposed in this paper to alleviate the problem of overfitting when training networks. The SD method works by dropping out units (channels of feature) from the network in a sequence, replacing the traditional operation of random omitting. Sophisticated aggregation strategies are used to obtain the global information of feature channels, and channel-wise weights are produced by gating mechanism. The SD method then selectively drops out the feature channels according to the channel-wise weights that represent the importance degree of each channel. The proposed SD block can be plugged into state-of-the-art backbone CNN models such as VGGNet and ResNet. The SD block is then evaluated on these models, demonstrating consistent performance gains over the baseline model on widely-used benchmark image classification datasets including MNIST, CIFAR-10, CIFAR-100, and ImageNet2012. Experimental results demonstrate that the superior performance of the SD block compared to other modern methods.
Keywords:
Training
Convolution
Neural networks
Computer architecture
Computer vision
Training data
Task analysis
Convolutional networks
image classification
overfitting
sequence-dropout
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

W
Wenzhou University
Scholars:
8.8K
Papers: 6.5K
Citations: 1.5W
Cited Papers

Cited Papers

510–515 nm InGaN-Based Green Laser Diodes onc-Plane GaN Substrate
err2009-05-22
err0
PREAI
errTakashi Miyoshi; Shingo Masui; Takeshi Okada; Tomoya Yanamoto; Tokuya Kozaki; Shin-ichi Nagahama; Takashi Mukai
errShare
errSave
Psychosocial impact of illness intrusiveness moderated by self-concept and age in end-stage renal disease.
err1997-01-01
err0
PREAI
errGerald M. Devins; Heather Beanlands; Henry Mandin; Leendert C. Paul
errShare
errSave
PTX encapsulated by an XG–DOX conjugate for combination therapy against multi-drug resistance
err2016-01-01
err0
PREAI
errZhuli Huang; Xuan Xie; Jean Felix Mukerabigwi; Chang Wang; Shufang Wang; Wang Xiao; Xueying Huang; Yu Cao
errShare
errSave
Bagging predictors
err1996-08-01
err1.0W
PREAI
errBreiman, L
errShare
errSave
researcher View more