arrow
Return

SiSL-Net: Saliency-guided self-supervised learning network for image classification

delete2022-10-01
delete6
PRE
AI
刘坤 cover
刘坤 (Kun Liu)
孟
孟蕊 (Rui Meng)
L
Longteng Li
J
Jingkun Mao
H
Haiyong Chen *
DOI:10.1016/j.neucom.2022.09.029delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The emergent studies and success on contrastive self-supervised learning have been well verified in the pretext task of instance discrimination, which learns visual representations by maximizing agreement between different augmented views of the same image sample (positive pairs). However, randomly crop-ping on original images may cause that the augmented view contains interference from a large propor-tion of the backgrounds, referred to as noisy data. Aiming to optimize the data augmentation and improve positive pairs, a Saliency-Augmented Module is proposed to obtain the augmented views, which only contain the latent object area, referred to as clean data. Furthermore, a Saliency-Guided Self -Supervised Learning Network (SiSL-Net) is constructed as a new pattern of contrastive learning. A sym-metric structure of trunk net and branch net is trained to learn a feature mapping from the clean data space and the noisy data space. Besides, a novel loss function is designed, including the embedding con-trastive loss and distribution consistency loss, to optimize the feature representations during network training. The linear classification performance of our SiSL-Net is evaluated on the miniImageNet dataset with ResNet-50. Experiments show that our method achieves the top-1 accuracy from 64.67% to 69.02%, outperforming the state-of-the-art performance. (c) 2022 Published by Elsevier B.V.
Keywords:
Positive pairs
Contrastive self -supervised learning
Saliency detection

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

T
Tianjin University of Technology
Scholars:
8.8K
Papers: 5.9K
Citations: 1.0W
H
hebei university of technology
Scholars:
1.8W
Papers: 1.2W
Citations: 10
Cited Papers

Cited Papers

errShare
errSave
Sémiologie tomodensitométrique de l’atteinte pulmonaire des connectivites
err2009-11-01
err0
PREAI
errP.Y. Brillet; N Mama; H Nunes; Y Uzunhan; S Abbad; M.W. Brauner
errShare
errSave
Self-Supervised Deep Correlation Tracking
err2021-01-01
err222
PREAI
errYuan, Di; Chang, Xiaojun; Huang, Po-Yao; Liu, Qiao; He, Zhenyu
errShare
errSave
Locomotor deficits in the mutant mouse, Lurcher
err1987-04-01
err0
PREAI
errP.A. Fortier; A.M. Smith; S. Rossignol
errShare
errSave
Association of the time course of pulmonary arterial hypertension with changes in oxidative stress in the left ventricle
err2011-11-27
err0
PREAI
errFabiano Leichsenring‐Silva; Angela Maria Vicente Tavares; Francisca Mosele; Bruno Berger; Susana Llesuy; Adriane Belló‐Klein
errShare
errSave
Adversarial self-supervised clustering with cluster-specificity distribution
err2021-08-01
err17
PREAI
errXia, Wei; Zhang, Xiangdong; Gao, Quanxue; Gao, Xinbo
errShare
errSave
Self-Supervised Feature Augmentation for Large Image Object Detection
err2020-01-01
err24
PREAI
errPan, Xingjia; Tang, Fan; Dong, Weiming; Gu, Yang; Song, Zhichao; Meng, Yiping; Xu, Pengfei; Deussen, Oliver; Xu, Changsheng
errShare
errSave
Super Diffusion for Salient Object Detection
err2020-01-01
err14
errOAAI
errJiang, Peng; Pan, Zhiyi; Tu, Changhe; Vasconcelos, Nuno; Chen, Baoquan; Peng, Jingliang
errShare
errSave
researcher View more