arrow
返回

Confidence-Enhanced Mutual Knowledge for Uncertain Segmentation

delete2024-01-01
delete6
PRE
AI
P
Ping Jiang
X
Xiaoheng Deng *
万少华 封面图
万少华 (Shaohua Wan) *
H
Huamei Qi
S
Shichao Zhang
DOI:10.1109/TITS.2023.3309600delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
It is inevitable to recognize objects in adverse weather conditions where the uncertainty of contour areas is increased. Although some multi-task learning frameworks have gained from the directional supervision between boundary detection and semantic segmentation, the interaction between those two tasks is poorly investigated. Moreover, the performance of the contour detection is expected to degrade under foggy scenarios, because the auxiliary task also has no benefits from the main task. To address the potential risk in intelligent transportation systems, this paper proposes a mutual learning framework, named CE-MGN (Confidence-Enhanced Mutual Graph Network), to propagate confidence through continuous interaction between different tasks rather than only focusing on the accuracy of the main task. The CE-MGN performs an end-to-end training paradigm and jointly learns two tasks, contour detection and semantic segmentation, through pairwise confidence-enhancement mechanism. Moreover, the task interaction is converted into graph space to further relieve the information loss during the feature aggregation in Euclidean space. Such a framework is capable to improve the robustness of respective tasks because of the encouragement from its peer task. Extensive experiments show that our CE-MGN achieved mean IoU scores of 79.35% and 79.03% on CityScapes and Foggy CityScapes datasets, respectively. Besides, our models have a stable performance on different weather severity, where the performance fluctuation is less than 1%.
Keyword:
Adverse weather scenarios
semantic segmentation
pairwise confidence-enhancement
mutual learning
graph neural network

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

C
Central South University
学者数:
10.0W
论文数: 7.2W
被引数: 10.9W
S
shenzhen institute for advanced study, uestc
学者数:
419
论文数: 371
被引数: 1
引用论文

引用论文

Semantic Foggy Scene Understanding with Synthetic Data
err2018-03-23
err676
PREAI
errSakaridis, Christos; Dai, Dengxin; Van Gool, Luc
err分享
err收藏
Edge-Based IIoT Malware Detection for Mobile Devices With Offloading
err2023-07-01
err7
PREAI
errDeng, Xiaoheng; Pei, Xinjun; Tian, Shengwei; Zhang, Lan
err分享
err收藏
Oxidative damage to fibronectin
err1991-02-01
err0
PREAI
errMargret C.M. Vissers; Christine C. Winterbourn
err分享
err收藏
学者 查看更多内容