arrow
Return

A multi-strategy contrastive learning framework for weakly supervised semantic segmentation

delete2023-05-01
delete14
delete
OA
AI
K
Kunhao Yuan
G
Gerald Schaefer
Yu-Kun Lai cover
Yu-Kun Lai (Yu‐Kun Lai)
Y
Yifan Wang
刘
刘习尧 (Xiyao Liu)
L
Lin Guan
方
方慧 (Hui Fang) *
DOI:10.1016/j.patcog.2022.109298delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Weakly supervised semantic segmentation (WSSS) has gained significant popularity as it relies only on weak labels such as image level annotations rather than the pixel level annotations required by super-vised semantic segmentation (SSS) methods. Despite drastically reduced annotation costs, typical feature representations learned from WSSS are only representative of some salient parts of objects and less re-liable compared to SSS due to the weak guidance during training. In this paper, we propose a novel Multi-Strategy Contrastive Learning (MuSCLe) framework to obtain enhanced feature representations and improve WSSS performance by exploiting similarity and dissimilarity of contrastive sample pairs at im-age, region, pixel and object boundary levels. Extensive experiments demonstrate the effectiveness of our method and show that MuSCLe outperforms current state-of-the-art methods on the widely used PASCAL VOC 2012 dataset.(c) 2023 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
Keywords:
Weakly supervised learning
Representation learning
Contrastive learning
Semantic segmentation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

L
Loughborough University
Scholars:
9.9K
Papers: 1.0W
Citations: 1.3W
C
Central South University
Scholars:
10.0W
Papers: 7.2W
Citations: 10.9W
C
Cardiff University
Scholars:
2.7W
Papers: 2.5W
Citations: 3.5W
researcher View more organizations
Cited Papers

Cited Papers

Edge-Sensitive Human Cutout With Hierarchical Granularity and Loopy Matting Guidance
err2020-01-01
err11
PREAI
errYe, Jingwen; Jing, Yongcheng; Wang, Xinchao; Ou, Kairi; Tao, Dacheng; Song, Mingli
errShare
errSave
Learning pseudo labels for semi-and-weakly supervised semantic segmentation
err2022-12-01
err9
PREAI
errWang, Yude; Zhang, Jie; Kan, Meina; Shan, Shiguang
errShare
errSave
LayerCAM: Exploring Hierarchical Class Activation Maps for Localization
err2021-01-01
err369
PREAI
errJiang, Peng-Tao; Zhang, Chang-Bin; Hou, Qibin; Cheng, Ming-Ming; Wei, Yunchao
errShare
errSave
Boundarymix: Generating pseudo-training images for improving segmentation with scribble annotations
err2021-09-01
err6
PREAI
errLu, Wanxuan; Gong, Dong; Fu, Kun; Sun, Xian; Diao, Wenhui; Liu, Lingqiao
errShare
errSave
End-to-end weakly supervised semantic segmentation with reliable region mining
err2022-08-01
err28
PREAI
errZhang, Bingfeng; Xiao, Jimin; Wei, Yunchao; Huang, Kaizhu; Luo, Shan; Zhao, Yao
errShare
errSave
Video semantic segmentation via feature propagation with holistic attention
err2020-08-01
err24
PREAI
errWu, Junrong; Wen, Zongzheng; Zhao, Sanyuan; Huang, Kele
errShare
errSave
Terrestrial Habitat Use and Winter Densities of the Wood Frog (Rana sylvatica)
err2003-04-01
err0
PREAI
errJonathan V. Regosin; Bryan S. Windmiller; J. Michael Reed
errShare
errSave
5-HT3 Receptor-independent Inhibition of the Depolarization-induced 86Rb Efflux from Human Neuroblastoma Cells, TE671, by Ondansetron
err1995-07-01
err0
PREAI
errJoyce Toral; William Hu; Donald Critchett; Andrew J Solomon; James E Barrett; Patricia T Sokol; M Reza Ziai
errShare
errSave
Gradient-base d refine d class activation map for weakly supervise d object localization
err2022-08-01
err8
PREAI
errHui, Wenjun; Tan, Chuangchuang; Gu, Guanghua; Zhao, Yao
errShare
errSave
no more