arrow
返回

Fast and Compact Image Segmentation Using Instance Stixels

delete2022-03-01
delete10
delete
OA
AI
T
Thomas M. Hehn
J
Julian F. P. Kooij
D
Dariu M. Gavrila *
DOI:10.1109/TIV.2021.3067223delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
State-of-the-art stixel methods fuse dense stereo disparity and semantic class information, e.g., from a Convolutional Neural Network (CNN), into a compact representation of driveable space, obstacles and background. However, they do not explicitly differentiate instances within the same semantic class. We investigate several ways to augment single-frame stixels with instance information, which can be extracted by a CNN from the RGB image input. As a result, our novel Instance Stixels method efficiently computes stixels that account for boundaries of individual objects, and represents instances as grouped stixels that express connectivity. Experiments on the Cityscapes dataset demonstrate that including instance information into the stixel computation itself, rather than as a post-processing step, increases the segmentation performance (i.e., Intersection over Union and Average Precision). This holds especially for overlapping objects of the same class. Furthermore, we show the superiority of our approach in terms of segmentation performance and computational efficiency compared to combining the separate outputs of Semantic Stixels and a state-of-the-art pixel-level CNN. We achieve processing throughput of 28 frames per second on average for 8 pixel wide stixels on images from the Cityscapes dataset at 1792 x 784 pixels. Our Instance Stixels software is made freely available for non-commercial research purposes.
Keyword:
Semantics
Image segmentation
Image color analysis
Automobiles
Roads
Pipelines
Data mining
Autonomous vehicles
image segmentation
machine vision

期刊

I
IEEE Transactions on Intelligent Vehicles
IF:
14.3
论文数:
1.3K
被引数:
1.2W

机构

D
Delft University of Technology
学者数:
2.6W
论文数: 2.5W
被引数: 3.8W
引用论文

引用论文

Bursting as a source of non‐linear determinism in the firing patterns of nigral dopamine neurons
err2012-07-25
err0
errOAAI
errJaeseung Jeong; Wei‐Xing Shi; Ralph Hoffman; Jihoon Oh; John C. Gore; Benjamin S. Bunney; Bradley S. Peterson
err分享
err收藏
err分享
err收藏
IgG4-related lung disease showing high standardized uptake values on FDG-PET: report of two cases
err2013-06-25
err0
errOAAI
errMasahiro Kitada; Yoshinari Matuda; Satoshi Hayashi; Kei Ishibashi; Kensuke Oikawa; Naoyuki Miyokawa; Yoshinobu Ohsaki
err分享
err收藏
学者 查看更多内容