arrow
返回

Unsupervised domain adaptive segmentation algorithm based on two-level category alignment

delete2024-09-01
delete1
PRE
AI
W
Wenyong Dong
Z
Zhixue Liang
L
Liping Wang
G
Gang Tian *
Q
Qianhui Long
DOI:10.1016/j.neunet.2024.106399delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To enhance the model's generalization ability in unsupervised domain adaptive segmentation tasks, most approaches have primarily focused on pixel-level local features, but neglected the clue in category information. This limitation results in the segmentation network only learning global inter-domain invariant features but ignoring the category-specific inter-domain invariant features, which degenerates the segmentation performance. To address this issue, we present an Unsupervised Domain Adaptive algorithm based on two-level Category Alignment in two different spaces for semantic segmentation tasks, denoted as UDA(ca+). The first level is imagelevel category alignment based on class activation map (CAM), and the second one is pixel-level category alignment based on pseudo label. By utilizing category information, UDA(ca+) can effectively capture domaininvariant yet category-discriminative feature representations to improve segmentation accuracy. In addition, an adversarial learning-based strategy in mixed domain is designed to train the proposed network. Moreover, a confidence calculation method is introduced to mitigate the misleading issues of negative transfer and over-alignment caused by the noise in image-level pseudo labels. UDA(ca+) achieves the state-of-the-art (SOTA) performance on two synthetic-to-real adaptative tasks, and verifies its effectiveness for image segmentation.
Keyword:
Unsupervised domain adaption
Semantic segmentation
Two-level category alignment
Class activation map
Generative adversarial network

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
7.8K
被引数:
3.0W

机构

W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Microcalorimetric studies on Tetrahymena pyriformis
err1991-07-01
err0
PREAI
errXie Chang-Li; Sun Day-Ung; Song Zhau-Hua; Qu Song-Sheng; Guo Yu; Li Bing
err分享
err收藏
CERN-MEDICIS (Medical Isotopes Collected from ISOLDE): A New Facility
err2014-05-16
err0
errOAAI
errRicardo Dos Santos Augusto; Leo Buehler; Zoe Lawson; Stefano Marzari; Monika Stachura; Thierry Stora; CERN-MEDICIS collaboration
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Determinants of quality of life in patients with fibromyalgia: A structural equation modeling approach纤维肌痛患者生活质量的决定因素: 结构方程建模方法
err2017-02-03
err0
errOAAI
errJeong-Won Lee; Kyung-Eun Lee; Dong-Jin Park; Seong-Ho Kim; Seong-Su Nah; Ji Hyun Lee; Seong-Kyu Kim; Yeon-Ah Lee; Seung-Jae Hong; Hyun-Sook Kim; Hye-Soon Lee; Hyoun Ah Kim; Chung-Il Joung; Sang-Hyon Kim; Shin-Seok Lee
err分享
err收藏
err分享
err收藏
学者 查看更多内容