arrow
Return

PASS: Panoramic Annular Semantic Segmentation

delete2020-10-01
delete72
PRE
AI
K
Kailun Yang
X
Xinxin Hu
L
Luis M. Bergasa
E
Eduardo Romera
K
Kaiwei Wang *
DOI:10.1109/TITS.2019.2938965delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Pixel-wise semantic segmentation is capable of unifying most of driving scene perception tasks, and has enabled striking progress in the context of navigation assistance, where an entire surrounding sensing is vital. However, current mainstream semantic segmenters are predominantly benchmarked against datasets featuring narrow Field of View (FoV), and a large part of vision-based intelligent vehicles use only a forward-facing camera. In this paper, we propose a Panoramic Annular Semantic Segmentation (PASS) framework to perceive the whole surrounding based on a compact panoramic annular lens system and an online panorama unfolding process. To facilitate the training of PASS models, we leverage conventional FoV imaging datasets, bypassing the efforts entailed to create fully dense panoramic annotations. To consistently exploit the rich contextual cues in the unfolded panorama, we adapt our real-time ERF-PSPNet to predict semantically meaningful feature maps in different segments, and fuse them to fulfill panoramic scene parsing. The innovation lies in the network adaptation to enable smooth and seamless segmentation, combined with an extended set of heterogeneous data augmentations to attain robustness in panoramic imagery. A comprehensive variety of experiments demonstrates the effectiveness for real-world surrounding perception in a single PASS, while the adaptation proposal is exceptionally positive for state-of-the-art efficient networks.
Keywords:
Semantics
Cameras
Image segmentation
Sensors
Navigation
Task analysis
Benchmark testing
Intelligent vehicles
scene parsing
semantic segmentation
scene understanding
panoramic annular images
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.5K
Citations:
6.3W

Organization

U
universidad de alcala
Scholars:
7.9K
Papers: 6.8K
Citations: 7
Z
zhejiang university
Scholars:
17.4W
Papers: 12.0W
Citations: 152