arrow
Return

Learning to Exploit the Prior Network Knowledge for Weakly Supervised Semantic Segmentation

delete2019-07-01
delete29
delete
OA
AI
R
Redondo-Cabrera, Carolina
B
Baptista-Rios, Marcos
R
Roberto J. López-Sastre *
DOI:10.1109/TIP.2019.2901393delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Training a convolutional neural network for semantic segmentation typically requires collecting a large amount of accurate pixel-level annotations and is a hard and expensive task. In contrast, simple image tags are easier to gather. In this paper, we introduce a novel weakly supervised semantic segmentation model which is able to learn from image labels and just image labels. Our model uses the prior knowledge of a network trained for image recognition, employing these image annotations as an attention mechanism to identify semantic regions in the images. We then present a methodology that builds accurate class-specific segmentation masks from these regions, where neither external objectness nor saliency algorithms are required. We describe how to incorporate this mask generation strategy into a fully end-to-end trainable process, where the network jointly learns to classify and segment images. Our experiments on PASCAL VOC 2012 dataset show that exploiting these generated class-specific masks in conjunction with our novel end-to-end learning process outperforms several recent weakly supervised semantic segmentation methods that use image tags only, and even some models that leverage additional supervision or training data.
Keywords:
Semantic segmentation
weakly supervised
deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
universidad de alcala
Scholars:
7.9K
Papers: 6.8K
Citations: 7
Cited Papers

Cited Papers

errShare
errSave
DNA protective and antioxidative effects of melatonin in streptozotocin-induced diabetic rats
err2015-01-01
err0
errOAAI
errSelim SEKKİN; Eda Duygu İPEK; Murat BOYACIOĞLU; Cavit KUM; Ümit KARADEMİR; Hande Sultan YALINKILINÇ; Mehmet Onur AK; Hulki BAŞALOĞLU
errShare
errSave
Learning to segment with image-level annotations
err2016-11-01
err67
PREAI
errWei, Yunchao; Liang, Xiaodan; Chen, Yunpeng; Jie, Zequn; Xiao, Yanhui; Zhao, Yao; Yan, Shuicheng
errShare
errSave
errShare
errSave
Short Hydrogen Bonds and Negative Charge in Photoactive Yellow Protein Promote Fast Isomerization but not High Quantum Yield
err2014-08-29
err0
errOAAI
errJingyi Zhu; Jocelyne Vreede; Marijke Hospes; Jos Arents; John T. M. Kennis; Ivo H. M. van Stokkum; Klaas J. Hellingwerf; Marie Louise Groot
errShare
errSave
Multi-parameter detection in fluid flows
err1995-03-01
err0
errOAAI
errJ. van Kuijk; T.S.J. Lammerink; H.-E. de Bree; M. Elwenspoek; J.H.J. Fluitman
errShare
errSave
err2003-01-01
err0
PREAI
errHiroshi Kishikawa; Jiro Nishida; Masaru Nakano; Erika Hirano; Tetsuo Morishita; Hiromasa Ishii
errShare
errSave
researcher View more