arrow
返回

Multilabel Concrete Bridge Damage Classification Using Graph Convolution

delete2024-01-01
delete0
PRE
AI
J
Jianxi Yang
H
Hao Li
张乐 封面图
张乐 (Le Zhang) *
L
Lu Zhao
蒋
蒋仕新 (Shixin Jiang)
H
Hong Xie
DOI:10.1109/TIM.2024.3400345delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
In recent years, the evolution of convolutional neural networks (CNNs) has paved the way for the development of deep-learning-based visual inspection techniques to identify damages in concrete bridges. However, the coexistence of diverse damage attributes within a single image complicates the comprehensive interpretation of these images during practical bridge inspections, posing a persistent challenge for existing single classification tasks. To address this issue, we introduce an innovative algorithm that synergizes graph convolutional network (GCN) and multiaxis vision transformer (MaxViT). Our approach leverages MaxViT to extract image features and subsequently models the co-occurrence correlation of labels. In addition, we use a graph CNN to extract features that capture the correlation between labels. Ultimately, we integrate these image features to enable multilabel classification of damage images. To evaluate the efficacy of our method, we curated a multilabel damage classification dataset for concrete bridges, consisting of 2098 samples encompassing the four prevalent types of spall, rebar, corrosion, and crack observed during bridge inspections. Experimental results showcase that our proposed method achieves a mean average precision (mAP) of 99.37% when applied to real bridge inspection images. In terms of general evaluation metrics, our method attains an accuracy of 98.29%, precision of 96.28%, recall of 97.08%, and F1-score of 96.68%. These findings underscore the superior performance of our method compared with current advanced multilabel classification networks, demonstrating higher accuracy. An interpretable analysis of the classification feature maps generated by our model, using the Grad-CAM algorithm, reveals that the model effectively directs attention to specific regions where damage is located. Consequently, our method holds promising engineering applications and has the potential to significantly enhance the accuracy of support provided for bridge inspection and maintenance endeavors.
Keyword:
Bridges
Inspection
Feature extraction
Classification algorithms
Accuracy
Image classification
Concrete
Concrete bridge damage classification
deep learning
feature fusion
graph convolutional network (GCN)
multilabel classification
transformer

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
6.1W

机构

C
chongqing jiaotong university
学者数:
604
论文数: 209
被引数: 0
引用论文

引用论文

Convolutional neural networks (CNNs)-based multi-category damage detection and recognition of high-speed rail (HSR) reinforced concrete (RC) bridges using test images
err2023-02-01
err53
PREAI
errChen, Lingkun; Chen, Wenxin; Wang, Lu; Zhai, Chencheng; Hu, Xiaolun; Sun, Linlin; Tian, Yuan; Huang, Xiaoming; Jiang, Lizhong
err分享
err收藏
Road damage detection using UAV images based on multi-level attention mechanism基于多级注意力机制的无人机影像路损检测
err2022-12-01
err52
PREAI
errZhang, Yingchao; Zuo, Zhiwu; Xu, Xiaobin; Wu, Jianqing; Zhu, Jianguo; Zhang, Hongbo; Wang, Jiewen; Tian, Yuan
err分享
err收藏
Detection of Coronary Artery Disease in Patients with Severe Aortic Stenosis with Noninvasive Methods
err1999-04-01
err0
PREAI
errSotirios P. Patsilinakos; Ioannis P. Antonelis; Gerasimos Filippatos; Irene K. Houssianakou; Nikolaos I. Zamanis; Elias Sioras; Theodora Tsiotika; Fotios Kardaras; Lambros P. Anthopoulos; Athanasios Kranidis
err分享
err收藏
Preparation of tissues for DNA flow cytometric analysis
err2005-06-16
err0
errOAAI
errJerry T. Thornthwaite; Everett V. Sugarbaker; Wally J. Temple
err分享
err收藏
学者 查看更多内容