arrow
返回

A Prototypical Knowledge Oriented Adaptation Framework for Semantic Segmentation

delete2022-01-01
delete10
PRE
AI
H
Haitao Tian *
Q
Qu, Shiru
P
Pierre Payeur
DOI:10.1109/TIP.2021.3128311delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
A prevalent family of fully convolutional networks are capable of learning discriminative representations and producing structural prediction in semantic segmentation tasks. However, such supervised learning methods require a large amount of labeled data and show inability of learning cross-domain invariant representations, giving rise to overfitting performance on the source dataset. Domain adaptation, a transfer learning technique that demonstrates strength on aligning feature distributions, can improve the performance of learning methods by providing inter-domain discrepancy alleviation. Recently introduced output-space based adaptation methods provide significant advances on cross-domain semantic segmentation tasks, however, a lack of consideration for intra-domain divergence of domain discrepancy remains prone to over-adaptation results on the target domain. To address the problem, we first leverage prototypical knowledge on the target domain to relax its hard domain label to a continuous domain space, where pixel-wise domain adaptation is developed upon a soft adversarial loss. The development of prototypical knowledge allows to elaborate specific adaptation strategies on under-aligned regions and well-aligned regions of the target domain. Furthermore, aiming to achieve better adaptation performance, we employ a unilateral discriminator to alleviate implicit uncertainty on prototypical knowledge. At last, we theoretically and experimentally demonstrate that the proposed prototypical knowledge oriented adaptation approach provides effective guidance on distribution alignment and alleviation on over-adaptation. The proposed approach shows competitive performance with state-of-the-art methods on two cross-domain segmentation tasks.
Keyword:
Image segmentation
Semantics
Task analysis
Adaptation models
Training
Visualization
Image classification
Domain adaptation
semantic segmentation
prototypical knowledge
unsupervised learning
transfer learning

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
U
University of Ottawa
学者数:
3.5W
论文数: 3.1W
被引数: 3.8W
引用论文

引用论文

err分享
err收藏
Spatial reconstruction of the sound field in a room in the modal frequency range using Bayesian inference
err2021-12-16
err0
errOAAI
errJonas M. Schmid; Efren Fernandez-Grande; Manuel Hahmann; Caglar Gurbuz; Martin Eser; Steffen Marburg
err分享
err收藏
Molecular analysis suggests oligoclonality and metastasis of endometriosis lesions across anatomically defined subtypes分子分析表明,子宫内膜异位症病变的寡克隆性和转移跨越解剖学定义的亚型
err2022-09-01
err0
errOAAI
errTeresa H. Praetorius; Anna Leonova; Vivian Lac; Janine Senz; Basile Tessier-Cloutier; Tayyebeh M. Nazeran; Martin Köbel; Marcel Grube; Bernhard Kraemer; Paul J. Yong; Stefan Kommoss; Michael S. Anglesio
err分享
err收藏
err分享
err收藏
Determinants of quality of life in patients with fibromyalgia: A structural equation modeling approach纤维肌痛患者生活质量的决定因素: 结构方程建模方法
err2017-02-03
err0
errOAAI
errJeong-Won Lee; Kyung-Eun Lee; Dong-Jin Park; Seong-Ho Kim; Seong-Su Nah; Ji Hyun Lee; Seong-Kyu Kim; Yeon-Ah Lee; Seung-Jae Hong; Hyun-Sook Kim; Hye-Soon Lee; Hyoun Ah Kim; Chung-Il Joung; Sang-Hyon Kim; Shin-Seok Lee
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容