arrow
Return

Multi-defect segmentation from facade images using balanced copy-paste method

delete2022-01-10
delete18
PRE
AI
J
Jiajun Li
王茜 cover
王茜 (Qian Wang) *
M
Ma Jun
J
Jingjing Guo
DOI:10.1111/mice.12808delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Facade defect is an unavoidable and considerable problem to existing buildings and can cause great influence to building owners. The traditional manual facade inspection method is costly, inefficient, and unsafe. Although recent studies achieved the classification of facade defects from images, pixel-level facade defect segmentation has not been tackled. Therefore, this study proposed and implemented a balanced copy-paste method with the Mask Region-based Convolutional Neural Network (Mask R-CNN) model to realize automatic detection and segmentation of facade defects. The proposed balanced copy-paste method was able to improve the recognition accuracy for minority classes and small objects. The proposed method was applied to a facade defect dataset with 2286 images that contained six common categories of defects. Comparisons with three other methods demonstrated that the proposed method could achieve the highest accuracy in defect detection (mean average precision (mAP) = 33.33) and segmentation (mAP = 27.26). Furthermore, compared to the original dataset, the proposed method could result in the greatest accuracy improvement for both minority classes (31% in detection and 32% in segmentation) and small objects (23% in detection and 19% in segmentation). Compared to the traditional over-sampling method and other methods based on algorithm level, the proposed method also showed higher computational efficiency.

Journal

C
Computer-Aided Civil and Infrastructure Engineering
IF:
9.1
Papers:
2.0K
Citations:
10.0K

Organization

N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W