返回
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks
DOI:10.1145/3510413.png)
摘要
En 中文
Several image processing tasks, such as image classification and object detection, have been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and EfficientNet, many architectures have achieved outstanding results in at least one dataset by the time of their creation. A critical factor in training concerns the network's regularization, which prevents the structure from overfitting. This work analyzes several regularization methods developed in the past few years, showing significant improvements for different CNN models. The works are classified into three main areas: the first one is called data augmentation, where all the techniques focus on performing changes in the input data. The second, named internal changes, aims to describe procedures to modify the feature maps generated by the neural network or the kernels. The last one, called label, concerns transforming the labels of a given input. This work presents two main differences comparing to other available surveys about regularization: (i) the first concerns the papers gathered in the manuscript, which are not older than five years, and (ii) the second distinction is about reproducibility, i.e., all works referred here have their code available in public repositories or they have been directly implemented in some framework, such as TensorFlow or Torch.
Keyword:
Regularization
convolutional neural networks
期刊
IF:
28
论文数:
2.4K
被引数:
3.5W
机构
引用论文
Adaptive Energy Management Strategy Calibration in PHEVs Based on a Sensitivity Study基于灵敏度研究的phev自适应能量管理策略标定
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
A novel and efficient xanthenic dye–organometallic ion‐pair complex for photoinitiating polymerization一种用于光引发聚合的新型高效的黄原胶染料-有机金属离子对配合物
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜

