arrow
返回

Weakly supervised semantic segmentation via self-supervised destruction learning

delete2023-12-01
delete4
PRE
AI
J
Jinlong Li
Z
Zequn Jie
X
Xu Wang *
Y
Yu Zhou
L
Lin Ma
J
Jianmin Jiang
DOI:10.1016/j.neucom.2023.126821delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Currently, weakly supervised semantic segmentation approaches adopt the Class Activation Map (CAM) to generate the initial attention maps from the standard classification backbone network, with only image-level class labels as training supervision. In this paper, we propose a novel destruction learningmethod via self-supervised manner, producing the CAM attention maps better covering the whole object rather than only the most discriminative regions as previous approaches. Region destruction mechanism is proposed to deliberately destructthe global structure in both Mid-Level and Low-Level feature learning following jigsaw puzzle operation, for better local feature extraction of the classification network. Specifically, a Mid-Level Distribution -and-Collection Module is proposed to firstly independently process local patches in parallel and then aggregate them, achieving enhanced local part sensitivity. For low-level destruction learning, a Low-Level Destruction Module is proposed to partition the original image into patches and shuffle them randomly to obtain a destructed image, which enforces the network to find weak information from the scattered discriminative small parts. The two destruction modules can be conveniently embedded into arbitrary backbone networks and trained in an end-to-end manner, without any extra annotations. Our proposed method achieves outstanding performance on the PASCAL VOC 2012 dataset (e.g., with 69.1% mIoU on the testing set), which surpasses existing state-of-the-art weakly supervised semantic segmentation methods.
Keyword:
Destruction learning
Weakly supervised learning
Semantic segmentation

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
引用论文

引用论文

Evolution of orbital angular momentum in three-dimensional structured light
err2018-10-24
err0
errOAAI
errAhmed H. Dorrah; Carmelo Rosales-Guzmán; Andrew Forbes; Mo Mojahedi
err分享
err收藏
Erase then grow: Generating correct class activation maps for weakly-supervised semantic segmentation
err2021-09-01
err13
PREAI
errChong, Yanwen; Chen, Xiaoshu; Tao, Yulong; Pan, Shaoming
err分享
err收藏
err分享
err收藏
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
err分享
err收藏
Sustainable use of sugarcane bagasse ash in cement-based materials
err2019-06-01
err0
PREAI
errPryscila Vinco Andreão; Ahmed R Suleiman; Guilherme Chagas Cordeiro; Moncef L Nehdi
err分享
err收藏
Binarization With Boosting and Oversampling for Multiclass Classification
err2016-05-01
err35
PREAI
errSen, Ayon; Islam, Md. Monirul; Murase, Kazuyuki; Yao, Xin
err分享
err收藏
学者 查看更多内容