arrow
Return

Channel modulus normalization for CNN image classification

delete2024-10-04
delete0
PRE
AI
S
Sijin Wang
Q
Qiuyu Zhu *
DOI:10.1007/s00530-024-01468-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper introduces a novel normalization operation, Channel Modulus Normalization (CMN), to enhance the image classification performance of traditional convolutional neural networks (CNNs) by leveraging latent feature characteristics across all levels. CMN is seamlessly integrated into existing CNN architectures without using additional trainable parameters. Following convolution operations at every level, CMN is applied to each feature map, utilizing a normalization adjustment factor to mitigate the influence of feature modulus length. This operation pays more attention to the change characteristics of the image details for classification. Experiments on six datasets such as CIFAR10, CIFAR100, FaceScrub, Tiny ImageNet, ImageNet (100), and ImageNet (1000), show that the channel modulus normalization operation can effectively improve the classification accuracy of the datasets above. Taking ResNet50 as an example, it is increased by 0.57%, 3.17%, 1.11%, 2.28%, 0.61% and 0.14% respectively. At the same time, the normalization operation will not increase the number of parameters of the model, and the convergence performance during training is better, which will only increase a small amount of calculation. The implementation code is available at https://github.com/99-WSJ/Channel-Modulus-Normalization.
Keywords:
Channel modulus
Normalization
Feature extraction
Convolutional neural network
Image classification

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.8K
Citations:
2.7K

Organization

S
shanghai university
Scholars:
3.9W
Papers: 2.7W
Citations: 52
Cited Papers

Cited Papers

The use of facial motion and facial form during the processing of identity
err2003-08-01
err0
PREAI
errBarbara Knappmeyer; Ian M Thornton; Heinrich H Bülthoff
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
Multiple sclerosis treatment effects on plasma cytokine receptor levels
err2018-02-01
err0
PREAI
errSahl Khalid Bedri; Katharina Fink; Ali Manouchehrinia; Wangko Lundström; Ingrid Kockum; Tomas Olsson; Jan Hillert; Anna Glaser
errShare
errSave
MEDIAL EPICONDYLECTOMY OR ULNAR-NERVE TRANSPOSITION FOR ULNAR NEUROPATHY AT THE ELBOW?
err1996-09-01
err0
PREAI
errG. G. Geutjens; R. J. Langstaff; N. J. Smith; D. Jefferson; C. J. Howell; N. J. Barton
errShare
errSave
researcher View more