arrow
返回

Context-aware adaptive network for UDA semantic segmentation

delete2024-07-05
delete2
PRE
AI
Y
Yu Yuan
J
Jinlong Shi *
X
Xin Shu
Q
Qiang Qian
Y
Yunna Song
D
Dan Xu
X
Xin Zuo
Y
YueCheng Yu
Y
Yunhan Sun
DOI:10.1007/s00530-024-01397-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unsupervised Domain Adaptation (UDA) plays a pivotal role in enhancing the segmentation performance of models in the target domain by mitigating the domain shift between the source and target domains. However, Existing UDA image mix methods often overlook the contextual association between classes, limiting the segmentation capability of the model. To address this issue, we propose the context-aware adaptive network that enhances the model's perception of contextual association information and maintains the contextual associations between different classes in mixed images, thereby improving the adaptability of the model. Firstly, we design a image mix strategy based on dynamic class correlation called DCCMix that constructs class correlation meta groups to preserve the contextual associations between different classes. Simultaneously, DCCMix dynamically adjusts the class proportion of the source domain within the mixed domain to gradually align with the distribution of the target domain, thereby improving training effectiveness. Secondly, the feature-wise fusion module and contextual feature-aware module are designed to better perceive contextual information of images and alleviate the issue of information loss during the feature extraction. Finally, we propose an adaptive class-edge weight to strengthen the segmentation ability of edge pixels in the model. Experimental results demonstrate that our proposed method achieves the mloU of 63.2% and 69.8% on two UDA benchmark tasks: SYNTHIA ->\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rightarrow$$\end{document} Cityscapes and GTA ->\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\rightarrow$$\end{document} Cityscapes respectively. The code is available at https://github.com/yuheyuan/CAAN.
Keyword:
Semantic segmentation
Unsupervised domain adaptation(UDA)
Image mix
Contextual Information

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

J
jiangsu university of science & technology
学者数:
9.0K
论文数: 6.9K
被引数: 9
引用论文

引用论文

Determinants of quality of life in patients with fibromyalgia: A structural equation modeling approach纤维肌痛患者生活质量的决定因素: 结构方程建模方法
err2017-02-03
err0
errOAAI
errJeong-Won Lee; Kyung-Eun Lee; Dong-Jin Park; Seong-Ho Kim; Seong-Su Nah; Ji Hyun Lee; Seong-Kyu Kim; Yeon-Ah Lee; Seung-Jae Hong; Hyun-Sook Kim; Hye-Soon Lee; Hyoun Ah Kim; Chung-Il Joung; Sang-Hyon Kim; Shin-Seok Lee
err分享
err收藏
学者 查看更多内容