arrow
Return

Image augmentation for nondestructive testing in engineering structures based on denoising diffusion probabilistic model

delete2024-07-01
delete1
PRE
AI
W
Wei Shen
D
Dongyang Zeng
张杨 (Yang Zhang) *
X
Xi Tian
Z
Ziqi Li
DOI:10.1016/j.jobe.2024.109299delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The performance of data-driven deep learning models relies on the quantity and quality of training data available. The scarcity of data in structural damage detection having been an important restriction for its rapid development. An image data augmentation method based on the denoising diffusion probabilistic model (DDPM) is proposed to focusing on structural damage detection task in this study. This approach employs a Markov chain sequence to progressively introduce random noise into the images, yielding isotropic Gaussian noise. By learning the reverse diffusion process, the original data is reconstructed from the Gaussian noise. Two sets of structural damage image data with varying complexities were utilized. Comparative studies were conducted against two widely used generative adversarial networks (GANs), including Wasserstein GAN-Gradient Penalty and Self-Attention GAN. the quality of generated images was evaluated using three metrics: inception score (IS), Frechet inception distance (FID), and kernel inception distance (KID). The experiments showed that the DDPM exhibits slightly better performance than GANs for low-complexity concrete crack image data. Specifically, it generates smooth images, whereas GAN-generated images contain more noise. The IS, FID and KID under DDPM are 2.45, 42.41 and 0.0326 respectively, while the best evaluation metrics under GANs are 2.38, 49.15 and 0.0377 respectively. For the high-complexity building damage image, the DDPM remains capable of generating high-quality images, while GANs can only generate images that are cluttered and severely distorted. It is shown that DDPM has significant advantages over GANs for augmenting high-complexity structural damage image data. Therefore, the proposed method can be applied to structural damage image data with different complexity, which provides a new method of high-quality data augmentation to address the problem of lack of training data in the field of deep learning-based intelligent damage detection.
Keywords:
Deep learning
Denoising diffusion probabilistic model
Image generation
Data augmentation
Intelligent damage detection

Journal

Journal of Building Engineering cover
Journal of Building Engineering
IF:
7.4
Papers:
1.6W
Citations:
6.6W

Organization

H
hong kong polytechnic university
Scholars:
3.0W
Papers: 4.1W
Citations: 921
G
guangxi university
Scholars:
3.3W
Papers: 1.8W
Citations: 25
N
Nanjing Tech University
Scholars:
3.6W
Papers: 2.3W
Citations: 3.9W
researcher View more organizations