arrow
返回

Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection: A Benchmark and Algorithms

delete2021-01-01
delete42
delete
OA
AI
R
Rui Fan *
H
Hengli Wang
Y
Yuan Wang
刘
刘明 (Liu, Ming)
P
Pitas, Ioannis
DOI:10.1109/TIP.2021.3112316delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing road pothole detection approaches can be classified as computer vision-based or machine learning-based. The former approaches typically employ 2D image analysis/ understanding or 3D point cloud modeling and segmentation algorithms to detect (i.e., recognize and localize) road potholes from vision sensor data, e.g., RGB images and/or depth/disparity images. The latter approaches generally address road pothole detection using convolutional neural networks (CNNs) in an end-to-end manner. However, road potholes are not necessarily ubiquitous and it is challenging to prepare a large well-annotated dataset for CNN training. In this regard, while computer vision-based methods were the mainstream research trend in the past decade, machine learning-based methods were merely discussed. Recently, we published the first stereo vision-based road pothole detection dataset and a novel disparity transformation algorithm, whereby the damaged and undamaged road areas can be highly distinguished. However, there are no benchmarks currently available for state-of-the-art (SoTA) CNNs trained using either disparity images or transformed disparity images. Therefore, in this paper, we first discuss the SoTA CNNs designed for semantic segmentation and evaluate their performance for road pothole detection with extensive experiments. Additionally, inspired by graph neural network (GNN), we propose a novel CNN layer, referred to as graph attention layer (GAL), which can be easily deployed in any existing CNN to optimize image feature representations for semantic segmentation. Our experiments compare GAL-DeepLabv3+, our best-performing implementation, with nine SoTA CNNs on three modalities of training data: RGB images, disparity images, and transformed disparity images. The experimental results suggest that our proposed GAL-DeepLabv3+ achieves the best overall pothole detection accuracy on all training data modalities. The source code, dataset, and benchmark are publicly available at mias.group/GAL-Pothole-Detection.
Keyword:
Roads
Image segmentation
Semantics
Convolutional neural networks
Feature extraction
Computer architecture
Benchmark testing
Road pothole detection
machine learning
convolutional neural network
graph neural network

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

T
tongji university
学者数:
7.9W
论文数: 6.0W
被引数: 98
A
aristotle university of thessaloniki
学者数:
2.6W
论文数: 2.0W
被引数: 19
引用论文

引用论文

Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Catalytic Mechanism of C–C Hydrolase MhpC from Escherichia coli: Kinetic Analysis of His263 and Ser110 Site-directed Mutants
err2005-02-01
err0
PREAI
errChen Li; Mark G. Montgomery; Fiyaz Mohammed; Jian-Jun Li; Stephen P. Wood; Timothy D.H. Bugg
err分享
err收藏
A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure
err2015-04-01
err725
errOAAI
errKoch, Christian; Georgieva, Kristina; Kasireddy, Varun; Akinci, Burcu; Fieguth, Paul
err分享
err收藏
学者 查看更多内容