arrow
返回

Toward Practical Weakly Supervised Semantic Segmentation via Point-Level Supervision

delete2023-08-12
delete4
PRE
AI
J
Junsong Fan
张
张兆翔 (Zhaoxiang Zhang) *
DOI:10.1007/s11263-023-01862-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Weakly supervised semantic segmentation (WSSS) aims to reduce the cost of collecting dense pixel-level annotations for segmentation models by adopting weak labels to train. Although WSSS methods have achieved great success, recent approaches mainly concern the image-level label-based WSSS, which is limited to object-centric datasets instead of more challenging practical datasets that contain many co-occurrent classes. In comparison, point-level labels could provide some spatial information to address the class co-occurrent confusion problem. Meanwhile, it only requires an additional click when recognizing the targets, which is of negligible annotation overhead. Thus, we choose to study utilizing point labels for the general-purpose WSSS. The main difficulty of utilizing point-level labels is bridging the gap between the sparse point-level labels and the dense pixel-level predictions. To alleviate this problem, we propose a superpixel augmented pseudo-mask generation strategy and a class-aware contrastive learning approach, which manages to recover reliable dense constraints and apply them both to the segmentation models' final prediction and the intermediate features. Diagnostic experiments on the challenging Pascal VOC, Cityscapes, and the ADE20k datasets demonstrate that our approach can efficiently and effectively compensate for the sparse point-level labels and achieve cutting-edge performance on the point-based segmentation problems.
Keyword:
Weakly supervised learning
Semantic segmentation
Deep learning

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
err分享
err收藏
Anthropogenic Noise Source and Intensity Effects on Mood and Relaxation in Simulated Park Environments
err2020-10-14
err0
errOAAI
errJacob A. Benfield; Gretchen A. Nurse Rainbolt; Lucy J. Troup; Paul A. Bell
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
err分享
err收藏
Purification and Characterization of a Purple Acid Phosphatase from Rat Spleen 1
err1984-01-01
err0
PREAI
errAkira HARA; Hideo SAWADA; Takashi KATO; Toshihiro NAKAYAMA; Hidetaka YAMAMOTO; Yasuhiro MATSUMOTO
err分享
err收藏
学者 查看更多内容