arrow
Return

Weakly Supervised Semantic Segmentation Via Progressive Patch Learning

delete2023-01-01
delete7
delete
OA
AI
J
Jinlong Li
Z
Zequn Jie
X
Xu Wang *
Y
Yu Zhou
X
Xiaolin Wei
L
Lin Ma
DOI:10.1109/TMM.2022.3152388delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most of the existing semantic segmentation approaches with image-level class labels as supervision, highly rely on the initial class activation map (CAM) generated from the standard classification network. In this paper, a novel Progressive Patch Learning approach is proposed to improve the local details extraction of the classification, producing the CAM better covering the whole object rather than only the most discriminative regions as in CAMs obtained in conventional classification models. Patch Learning destructs the feature maps into patches and independently processes each local patch in parallel before the final aggregation. Such a mechanism enforces the network to find weak information from the scattered discriminative local parts, achieving enhanced local details sensitivity. Progressive Patch Learning further extends the feature destruction and patch learning to multi-level granularities in a progressive manner. Cooperating with a multi-stage optimization strategy, such a Progressive Patch Learning mechanism implicitly provides the model with the feature extraction ability across different locality-granularities. As an alternative to the implicit multi-granularity progressive fusion approach, we additionally propose an explicit method to simultaneously fuse features from different granularities in a single model, further enhancing the CAM quality on the full object coverage. Our proposed method achieves outstanding performance on the PASCAL VOC 2012 dataset (e.g., with 69.6$\%$ mIoU on the test set), which surpasses most existing weakly supervised semantic segmentation methods.
Keywords:
Weakly supervised learning
semantic segmentation
patch learning
progressive learning

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

S
shenzhen university
Scholars:
4.6W
Papers: 3.4W
Citations: 72
G
guangming laboratory
Scholars:
267
Papers: 199
Citations: 0
Cited Papers

Cited Papers

Forced vibration experiments on flexible piezoelectric devices operating in air and water environments
err2014-02-01
err0
PREAI
errYoshikazu Tanaka; Takuya Oko; Hidemi Mutsuda; Atanas A. Popov; Rupesh Patel; Stewart McWilliam
errShare
errSave
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition
err2019-06-01
err952
errOAAI
errWu, Zifeng; Shen, Chunhua; van den Hengel, Anton
errShare
errSave
errShare
errSave
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction
err
IF0
err2017-10-09
err0
errOAAI
errMichael P Menden; Dennis Wang; Yuanfang Guan; Mike J Mason; Bence Szalai; Krishna C Bulusu; Thomas Yu; Jaewoo Kang; Minji Jeon; Russ Wolfinger; Tin Nguyen; Mikhail Zaslavskiy; Sock Jang; Zara Ghazoui; Mehmet Eren Ahsen; Robert Vogel; Elias Chaibub Neto; Thea Norman; Eric KY Tang; Mathew J Garnett; Giovanni Di Veroli; Stephen Fawell; Gustavo Stolovitzky; Justin Guinney; Jonathan R. Dry; Julio Saez-Rodriguez
errShare
errSave
Sustainable use of sugarcane bagasse ash in cement-based materials
err2019-06-01
err0
PREAI
errPryscila Vinco Andreão; Ahmed R Suleiman; Guilherme Chagas Cordeiro; Moncef L Nehdi
errShare
errSave
Top-Down Neural Attention by Excitation Backprop
err2017-12-23
err413
PREAI
errZhang, Jianming; Bargal, Sarah Adel; Lin, Zhe; Brandt, Jonathan; Shen, Xiaohui; Sclaroff, Stan
errShare
errSave
researcher View more