arrow
Return

Positional normalization-based mixed-image data augmentation and ensemble self-distillation algorithm

delete2024-10-01
delete1
PRE
AI
W
Wenjie Chen *
Y
Yunbing Hu
M
Min Peng
B
Bowen Zhu
DOI:10.1016/j.eswa.2024.124140delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The prior approach to data augmentation using positional normalization necessitated manual determination of weight parameters for blending two images. However, theoretically, these parameters cannot cater to all samples. We propose a novel data augmentation approach called pnMix (Positional normalization-based data mixing) based on data blending and positional normalization to address these issues. Moreover, we have improved the teacher model of an existing network structure based on self-distillation technology using an ensembling approach called ESKD. Our method enhances performance across multiple datasets and tasks. We outperform previous methods in complex real-world datasets such as imagenet-a and imagenet-o, which we believe are highly meaningful for practical applications. Specifically, we obtain good results on the CIFAR100 and Imagenet image classification datasets, the Pascal VOC and COCO object detection datasets, and the COCO and Cityscapes image segmentation datasets. Furthermore, we analyze the pnMix method's advantages compared to other data augmentation methods through visualization techniques, demonstrating its effectiveness and interpretability. Our source code and pre-trained models are available at https://github.com/sydney72380/pnMix.
Keywords:
Data augmentation
Positional normalization
Image mixing
Knowledge self-distillation

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

C
chongqing college of electronic engineering
Scholars:
171
Papers: 168
Citations: 0
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
ImageNet Classification with Deep Convolutional Neural Networks
err2017-05-24
err8.3W
errOAAI
errKrizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E.
errShare
errSave
CoSense
err2013-11-11
err0
PREAI
errSamuli Hemminki; Kai Zhao; Aaron Yi Ding; Martti Rannanjärvi; Sasu Tarkoma; Petteri Nurmi
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
researcher View more