.png){kind=icon}
返回
CAA: Class-Aware Affinity calculation add-on for semantic segmentation
.png){kind=icon}
OA
AI
DOI：10.1016/j.knosys.2024.112097.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Leveraging contextual dependencies is a commonly used technique to enhance the performance of image segmentation. However, existing solutions do not effectively catch the class-level association between the pixels along the boundary across the objects of the different classes but focus more on the local pixel -to -pixel relation. This work proposes a Class-Aware Affinity module (CAA) that considers both pixel -to -pixel relation and pixel-to-class association. We try to argue that the pixel -to -pixel relations still catch the relation ( e.g. similarity, attention, or affiliation) on the local texture level. At the same time, it should also consider the association between the pixel and the class context produced by the given image. Pixel-to-class association can best reveal the co-occurrent dependency on the semantic level between the given pixels and their nearby context. Such pixel-to-class association combined with the pixel -to -pixel relations aggregating the local texture information will best mitigate the confusion caused in the boundary regions across the objects of the different classes. Moreover, the proposed framework can serve as a generic add-on to be integrated with the existing image segmentation solution to boost the current performance. Equipped with CAA, we achieve promising performance against the existing work with 54.59% mIoU on ADE20K, 49.96% mIoU on COCO-Stuff10k, and 64.38% mIoU on Pascal-Context.
Keyword:
Semantic segmentation
Affinity
Contextual dependencies
Class association
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Recent Development of Dual-Dictionary Learning Approach in Medical Image Analysis and ReconstructionOAAI
OAAI分享收藏Deep multi-level fusion network for multi-source image pixel-wise classification用于多源图像按像素分类的深度多级融合网络
PREAI
分享收藏
查看更多内容