Single annotated pixel based weakly supervised semantic segmentation under driving scenes

doi:10.1016/j.patcog.2021.107979

Single annotated pixel based weakly supervised semantic segmentation under driving scenes

2021-08-01

8

PRE

AI

DOI：10.1016/j.patcog.2021.107979

Original

Original request for help

Save

Abstract

En 中文

Semantic segmentation tasks based on weakly supervised conditions have been put forward to achieve a lightweight labeling process. For simple images that only include a few categories, research based on image-level annotations has achieved acceptable performance. However, when facing complex scenes, since image contains a large number of classes, it becomes challenging to learn visual appearance based on image tags. In this case, image-level annotations are not useful in providing information. Therefore, we set up a new task in which a single annotated pixel is provided for each category in a whole dataset. Based on the more lightweight and informative condition, a three step process is built for pseudo labels generation, which progressively implements each class' optimal feature representation, image inference, and context-location based refinement. In particular, since high-level semantics and low-level imaging features have different discriminative abilities for each class under driving scenes, we divide categories into object or scene and then provide different operations for the two types separately. Further, an alternate iterative structure is established to gradually improve segmentation performance, which com-bines CNN-based inter-image common semantic learning and imaging prior based intra-image modifica-tion process. Experiments on the Cityscapes dataset demonstrate that the proposed method provides a feasible way to solve weakly supervised semantic segmentation tasks under complex driving scenes. (c) 2021 Elsevier Ltd. All rights reserved.

Keywords:

Weakly supervised condition

Semantic segmentation

Complex driving scenes

Optimal feature setting

Single annotated pixel based weakly supervised semantic segmentation under driving scenes

Abstract

AI Summary

Journal

Organization

Cited Papers