arrow
Return

Semantic Scene Labeling via Deep Nested Level Set

delete2021-11-01
delete5
delete
OA
AI
P
Pingping Zhang
刘伟 (Wei Liu)
Y
Yinjie Lei *
卢湖川 (Huchuan Lu)
DOI:10.1109/TITS.2020.2995730delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Semantic scene labeling plays a very important role in intelligent transportation tasks, such as autonomous driving and advanced driver assistance. Recently, thanks to the advances of deep learning, significant improvements have been achieved for this pixel-wise labeling task. Although effective, current methods lack of explicitly modeling the boundary of objects, resulting in inaccurate labeling results. Meanwhile, traditional level set based methods perform better to capture the evolution of boundaries. However, they are sensitive to the model initialization. To address these issues, in this work we propose a novel deep learning framework, named deep nested level set (DNLS) for boundary-aware semantic scene labeling. Different from previous works, our proposed framework explicitly takes deep learned features and object boundary information into account. More specifically, our proposed framework first predicts semantic probability maps and boundary locations of objects using a bifurcated fully convolutional network (BFCN). Then, these probability maps are seamlessly integrated into a nested level set function for accurate scene labeling. As a result, our approach can automatically initialize the nested level set function, and the whole framework can be trained in an end-to-end manner, providing a new solution for accurate semantic scene parsing. Extensive experiments on public CamVid and Cityscapes datasets demonstrate that our proposed framework produces high-quality predictions with clear object boundaries and spatial consistency.
Keywords:
Level set
Semantics
Labeling
Feature extraction
Deep learning
Image segmentation
Intelligent transportation systems
Semantic scene labeling
deep nested level set
image boundary estimation
fully convolutional network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.5K
Citations:
6.3W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W
S
sichuan university
Scholars:
11.9W
Papers: 7.7W
Citations: 100
D
Dalian University of Technology
Scholars:
5.8W
Papers: 4.3W
Citations: 5.5W
researcher View more organizations