arrow
返回

Interactive defect quantification through extended reality

delete2022-01-01
delete16
PRE
AI
Z
Zaid Abbas Al‐Sabbag
C
Chul Min Yeum *
S
Sriram Narasimhan
DOI:10.1016/j.aei.2021.101473delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
In this study, a new visual inspection method that can interactively detect and quantify structural defects using an Extended Reality (XR) device (headset) is proposed. The XR device, which is at the core of this method, supports an interactive environment using a holographic overlay of graphical information on the spatial environment and physical objects being inspected. By leveraging this capability, a novel XR-supported inspection pipeline, called eXtended Reality-based Inspection and Visualization (XRIV), is developed. Key tasks supported by this method include detecting visual damage from sensory data acquired by the XR device, estimating its size, and visualizing (overlaying) information on the spatial environment. The crucial step of real-time interactive segmentation-detection and pixel-wise damage boundary refinement-is achieved using a feature Back-propagating Refinement Scheme (f-BRS) algorithm. Then, a ray-casting algorithm is applied to back-project the 2D image pixel coordinates of the damage region to their 3D world coordinates for damage area quantification in real-world (physical) units. Finally, the area information is overlaid and anchored to the scene containing damage for visualization and documentation. The performance of XRIV is experimentally demonstrated by measuring surface structural damage of an in-service concrete bridge with less than 10% errors for two different test cases, and image processing latency of 2-3 s (or 0.5 s per seed point) from f-BRS. The proposed XRIV pipeline underscores the advantages of real-time interaction between expert users and the XR device through immersive visualization so that a human-machine collaborative workflow can be established to obtain better inspection outcomes in terms of accuracy and robustness.
Keyword:
Visual inspection
Extended reality
Augmented reality
Damage detection

期刊

Advanced Engineering Informatics 封面图
Advanced Engineering Informatics
IF:
9.9
论文数:
4.5K
被引数:
2.6W

机构

University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 55.6W
U
University of Waterloo
学者数:
1.3K
论文数: 583
被引数: 1.8W
引用论文

引用论文

White-Matter Damage in Clade C HIV-Positive Subjects: A Diffusion Tensor Imaging Study
err2011-07-01
err0
PREAI
errJacqueline Hoare; Jean-Paul Fouche; Bruce Spottiswoode; Katherine Sorsdahl; Marc Combrinck; Dan J. Stein; Robert H. Paul; John A. Joska
err分享
err收藏
Study protocol of the YP Face IT feasibility study: comparing an online psychosocial intervention versus treatment as usual for adolescents distressed by appearance-altering conditions/injuries
err2016-10-03
err0
errOAAI
errHeidi Williamson; Claire Hamlet; Paul White; Elsa M R Marques; Julia Cadogan; Rohan Perera; Nichola Rumsey; Leighton Hayward; Diana Harcourt
err分享
err收藏
An Automatic Concrete Crack-Detection Method Fusing Point Clouds and Images Based on Improved Otsu's Algorithm
errSENSORS
IF3.5
err2021-02-24
err40
errOAAI
errChen, Xiaolong; Li, Jian; Huang, Shuowen; Cui, Hao; Liu, Peirong; Sun, Quan
err分享
err收藏
Az oxidatív stressz szerepe a diabeteses neuropathia kialakulásában
err2016-12-01
err0
errOAAI
errFerenc Sztanek; Ágnes Molnárné Molnár; Zoltán Balogh
err分享
err收藏
学者 查看更多内容