arrow
Return

Super-resolution semantic segmentation with relation calibrating network

delete2022-04-01
delete11
PRE
AI
J
Jie Jiang
J
Jing Liu *
J
Jun Fu
王
王卫宁 (Wang, Weining)
卢
卢汉清 (Hanqing Lu)
DOI:10.1016/j.patcog.2021.108501delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
To achieve high-resolution segmentation results, typical semantic segmentation models often require high-resolution inputs. However, high-resolution inputs inevitably bring high cost on computation, which limits its application seriously in realistic scenarios. To address the problem, we propose to predict a high-resolution semantic segmentation result with a degraded low-resolution image as input, which is called super-resolution semantic segmentation in this paper. We further propose a Relation Calibrating Network (RCNet) for this task. Specifically, we propose two modules, namely Relation Upsampling Module (RUM) and Feature Calibrating Module (FCM). In RUM, the input feature map generates the relation map of pixels in low-resolution, which is then gradually upsampled to high-resolution. Meanwhile, FCM takes the input feature map and the relation map from RUM as inputs, gradually calibrating the feature. Finally, the last FCM outputs the high-resolution segmentation results. We conduct extensive experiments to verify the effectiveness of our method. Specially, we achieve a comparable segmentation result (from 70.01% to 70.90%) with only 1/4 of the computational cost (from 1107.57 to 255.72 GFLOPs) based on FCN on Cityscapes dataset. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Image semantic segmentation
Super-resolution semantic segmentation
Relation calibrating

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.4W
Citations:
4.5W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
errShare
errSave
Spatial context-aware network for salient object detection
err2021-06-01
err27
PREAI
errKong, Yuqiu; Feng, Mengyang; Li, Xin; Lu, Huchuan; Liu, Xiuping; Yin, Baocai
errShare
errSave
Label group diffusion for image and image pair segmentation
err2021-04-01
err3
PREAI
errWang, Tao; Ji, Zexuan; Yang, Jian; Sun, Quansen; Shen, Xiaobo; Ren, Zhenwen; Ge, Qi
errShare
errSave
Semantic Segmentation With Context Encoding and Multi-Path Decoding
err2020-01-01
err123
PREAI
errDing, Henghui; Jiang, Xudong; Shuai, Bing; Liu, Ai Qun; Wang, Gang
errShare
errSave
Efficient semantic segmentation with pyramidal fusion
err2021-02-01
err73
PREAI
errOrsic, Marin; Segvic, Sinisa
errShare
errSave
Enhanced Local Subspace Affinity for feature-based motion segmentation
err2011-02-01
err39
PREAI
errZappella, L.; Llado, X.; Provenzi, E.; Salvi, J.
errShare
errSave
Contextual deconvolution network for semantic segmentation
err2020-05-01
err46
PREAI
errFu, Jun; Liu, Jing; Li, Yong; Bao, Yongjun; Yan, Weipeng; Fang, Zhiwei; Lu, Hanqing
errShare
errSave
researcher View more