1
Return

A dual-phase transformer with multi-dimensional fusion for real-time steel surface defect detection

delete2026-06-23
delete0
PRE
AI
Y
Yiyang Lu
J
Jun Li *
J
Jingjing Zhang
DOI:10.1080/10589759.2026.2693725delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Accurate detection of small and low-contrast objects remains a major challenge for modern object detectors, particularly in defect detection. Inherent limitations, including shape variation, size variation, and low-contrast defects in defective images, severely hinder the performance of existing detection frameworks. To tackle these issues, we develop a real-time, end-to-end transformer detector, named dual-phase hybrid multi-dimensional DETR (DHM-DETR). Firstly, we design a multi-dimensional feature fusion (MDFF) block, which leverages element-wise multiplication and residual connections to enhance implicit feature dimensions, particularly improving detection sensitivity for low-contrast defects and small objects. Secondly, a hybrid query propagation (HQP) mechanism is developed to redistribute supervision across decoder stages, improving feature refinement and convergence stability. Thirdly, we devise a dual-phase hybrid strategy (DHS) to dynamically adapt the decoder architecture based on training epochs, boosting convergence efficiency while minimising computational overhead. Extensive experiments are performed on the NEU-DET and GC10-DET defect detection datasets to assess the effectiveness of the proposed method, achieving significant improvements of 3.1% and 5.1% in mAP50 over state-of-the-art methods. Data perturbation study and model generalisation analysis on ASSDD dataset validate the robustness and transferability of our model, highlighting its effectiveness in challenging industrial inspection scenarios.
Keywords:
End-to-end transformer detector
defect detection
object detection
low-contrast defects

Journal

N
Nondestructive Testing and Evaluation
IF:
4.2
Papers:
1.7K
Citations:
2.1K

Organization

N
nanjing university of science and technology
Scholars:
2.9K
Papers: 994
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers