arrow
返回

Erroneous pixel prediction for semantic image segmentation

delete2022-03-01
delete9
delete
OA
AI
G
Gong, Lixue
Y
Yiqun Zhang
Y
Yunke Zhang
Y
Yin Yang
W
Weiwei Xu *
DOI:10.1007/s41095-021-0235-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We consider semantic image segmentation. Our method is inspired by Bayesian deep learning which improves image segmentation accuracy by modeling the uncertainty of the network output. In contrast to uncertainty, our method directly learns to predict the erroneous pixels of a segmentation network, which is modeled as a binary classification problem. It can speed up training comparing to the Monte Carlo integration often used in Bayesian deep learning. It also allows us to train a branch to correct the labels of erroneous pixels. Our method consists of three stages: (i) predict pixel-wise error probability of the initial result, (ii) redetermine new labels for pixels with high error probability, and (iii) fuse the initial result and the redetermined result with respect to the error probability. We formulate the error-pixel prediction problem as a classification task and employ an error-prediction branch in the network to predict pixel-wise error probabilities. We also introduce a detail branch to focus the training process on the erroneous pixels. We have experimentally validated our method on the Cityscapes and A DE2OK datasets. Our model can be easily added to various advanced segmentation networks to improve their performance. Taking DeepLabv3+ as an example, our network can achieve 82.88% of mIoU on Cityscapes testing dataset and 45.73% on ADE2OK validation dataset, improving corresponding DeepLabv3+ results by 0.74% and 0.13% respectively.
Keyword:
erroneous pixel prediction
image segmentation
deep learning

期刊

Computational Visual Media 封面图
Computational Visual Media
IF:
18.3
论文数:
316
被引数:
2.6K

机构

C
Clemson University
学者数:
1.3W
论文数: 1.1W
被引数: 1.4W
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Semantic Understanding of Scenes Through the ADE20K Dataset通过ADE20K数据集对场景进行语义理解
err2018-12-07
err934
PREAI
errZhou, Bolei; Zhao, Hang; Puig, Xavier; Xiao, Tete; Fidler, Sanja; Barriuso, Adela; Torralba, Antonio
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Deer mice: “The Drosophila of North American mammalogy”
err2001-03-08
err0
PREAI
errMichael J. Dewey; Wallace D. Dawson
err分享
err收藏
Phosphate Phosphors for Solid-State Lighting
err2012-01-01
err0
errOAAI
errKartik N. Shinde; S.J. Dhoble; H.C. Swart; Kyeongsoon Park
err分享
err收藏
学者 查看更多内容