.png){kind=icon}
.png){kind=icon}
Return
SiSL-Net: Saliency-guided self-supervised learning network for image classification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2022.09.029.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The emergent studies and success on contrastive self-supervised learning have been well verified in the pretext task of instance discrimination, which learns visual representations by maximizing agreement between different augmented views of the same image sample (positive pairs). However, randomly crop-ping on original images may cause that the augmented view contains interference from a large propor-tion of the backgrounds, referred to as noisy data. Aiming to optimize the data augmentation and improve positive pairs, a Saliency-Augmented Module is proposed to obtain the augmented views, which only contain the latent object area, referred to as clean data. Furthermore, a Saliency-Guided Self -Supervised Learning Network (SiSL-Net) is constructed as a new pattern of contrastive learning. A sym-metric structure of trunk net and branch net is trained to learn a feature mapping from the clean data space and the noisy data space. Besides, a novel loss function is designed, including the embedding con-trastive loss and distribution consistency loss, to optimize the feature representations during network training. The linear classification performance of our SiSL-Net is evaluated on the miniImageNet dataset with ResNet-50. Experiments show that our method achieves the top-1 accuracy from 64.67% to 69.02%, outperforming the state-of-the-art performance. (c) 2022 Published by Elsevier B.V.
Keywords:
Positive pairs
Contrastive self -supervised learning
Saliency detection
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W