arrow
返回

Bridge damage description using adaptive attention-based image captioning

delete2024-09-01
delete1
PRE
AI
S
Shunlong Li
M
Minghao Dang
Y
Yang Xu
A
Andong Wang
Y
Yapeng Guo *
DOI:10.1016/j.autcon.2024.105525delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Current many vision -based research uses various classification, detection, and segmentation methods to identify bridge damage. Instead of these numerical results, a highly abstract natural language description is a more suitable method to summarize and transmit bridge inspection processes and results to humans. This paper presents an end -to -end image captioning -based bridge damage comprehensive description network (BDCD-Net) for describing and locating bridge damage. BDCD-Net consists of two parts: an image feature encoder (extracting multi -level image features from bridge damage images) and a bridge damage description generation decoder (employing an adaptive attention mechanism to selectively utilize image features to generate descriptions and locate damage). The descriptions include component types, damage categories, relative spatial positions of the damaged components and bridges, and shooting angles of the image. The effectiveness of BDCD-Net was validated using images collected from real bridges with annotated descriptions. The results indicate the significant potential of fully automated bridge inspection.
Keyword:
Bridge damage
Comprehensive description
Image captioning
Adaptive attention
Multimodal learning

期刊

Automation in Construction 封面图
Automation in Construction
IF:
11.5
论文数:
6.3K
被引数:
4.2W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
引用论文

引用论文

A novel transformer model for surface damage detection and cognition of concrete bridges
err2023-03-01
err38
PREAI
errWan, Haifeng; Gao, Lei; Yuan, Zhaodi; Qu, Hui; Sun, Qirun; Cheng, Hao; Wang, Ruibao
err分享
err收藏
Process Analytical Technology and Quality by Design for Animal Cell Culture
err2019-09-20
err0
PREAI
errHae‐Woo Lee; Hemlata Bhatia; Seo‐Young Park; Mark‐Henry Kamga; Thomas Reimonn; Sha Sha; Zhuangrong Huang; Shaun Galbraith; Huolong Liu; Seongkyu Yoon
err分享
err收藏
err分享
err收藏
Anti-drug antibodies anti-trastuzumab in the treatment of breast cancer
err2020-09-01
err0
PREAI
errIvette Mourani Padrón; Jonathan González García; Ruth Ramos Díaz; Isaac Ceballos Lenza; Fernando Gutiérrez Nicolás
err分享
err收藏
学者 查看更多内容