arrow
返回

Cluster Alignment With Target Knowledge Mining for Unsupervised Domain Adaptation Semantic Segmentation

delete2022-01-01
delete10
delete
OA
AI
王爽 封面图
王爽 (Shuang Wang) *
D
Dong Zhao
C
Chi Zhang
Y
Yuwei Guo
Q
Qi Zang
Y
Yu Gu
Y
Yi Li
焦李成 封面图
焦李成 (Licheng Jiao)
DOI:10.1109/TIP.2022.3222634delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unsupervised domain adaptation (UDA) carries out knowledge transfer from the labeled source domain to the unlabeled target domain. Existing feature alignment methods in UDA semantic segmentation achieve this goal by aligning the feature distribution between domains. However, these feature alignment methods ignore the domain-specific knowledge of the target domain. In consequence, 1) the correlation among pixels of the target domain is not explored; and 2) the classifier is not explicitly designed for the target domain distribution. To conquer these obstacles, we propose a novel cluster alignment framework, which mines the domain-specific knowledge when performing the alignment. Specifically, we design a multi-prototype clustering strategy to make the pixel features within the same class tightly distributed for the target domain. Subsequently, a contrastive strategy is developed to align the distributions between domains, with the clustered structure maintained. After that, a novel affinity-based normalized cut loss is devised to learn task-specific decision boundaries. Our method enhances the model's adaptability in the target domain, and can be used as a pre-adaptation for self-training to boost its performance. Sufficient experiments prove the effectiveness of our method against existing state-of-the-art methods on representative UDA benchmarks.
Keyword:
Adaptation models
Correlation
Semantic segmentation
Clustering methods
Transforms
Benchmark testing
Task analysis
Unsupervised domain adaptation (UDA)
semantic segmentation
clustering
graph cut

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.8W
论文数: 10.9W
被引数: 130
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

CERN-MEDICIS (Medical Isotopes Collected from ISOLDE): A New Facility
err2014-05-16
err0
errOAAI
errRicardo Dos Santos Augusto; Leo Buehler; Zoe Lawson; Stefano Marzari; Monika Stachura; Thierry Stora; CERN-MEDICIS collaboration
err分享
err收藏
Determinants of quality of life in patients with fibromyalgia: A structural equation modeling approach纤维肌痛患者生活质量的决定因素: 结构方程建模方法
err2017-02-03
err0
errOAAI
errJeong-Won Lee; Kyung-Eun Lee; Dong-Jin Park; Seong-Ho Kim; Seong-Su Nah; Ji Hyun Lee; Seong-Kyu Kim; Yeon-Ah Lee; Seung-Jae Hong; Hyun-Sook Kim; Hye-Soon Lee; Hyoun Ah Kim; Chung-Il Joung; Sang-Hyon Kim; Shin-Seok Lee
err分享
err收藏
Gross primary production of Mediterranean watersheds: Using isotope mass balance approach to improve estimations
err2024-01-23
err0
errOAAI
errAlexandra Mattei; Frédéric Huneau; Emilie Garel; Sébastien Santoni; Thomas Leydier; Yuliya Vystavna
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容