1
Return

MS-CRTU: A Convolutional Retentive Transformer With Multiscale Fusion for Breast Ultrasound Image Classification

delete2026-06-30
delete0
delete
OA
AI
K
Kaicheng Lin
B
Bo Xu *
Y
Ying Wu
DOI:10.1002/ima.70406delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Accurate classification of breast ultrasound images (BUSI) is crucial for the early diagnosis of breast cancer. Current deep learning models still have limitations in this task, primarily due to the insufficient global modeling capabilities of convolutional neural networks (CNNs) and the lack of local detail and spatial inductive bias in vision transformers (ViTs). Additionally, how to effectively fuse multiscale features to address lesions of varying sizes remains a major challenge in this field. To address these issues, this paper proposes a novel multiscale convolution retentive transformer (MS-CRTU) network. The network first uses a CNN module to extract key local texture features from ultrasound images. Subsequently, to synergistically model local and global information from shallow to deep levels, the feature maps are fed into the core processing stage composed of our designed convolution-retentive transformer block (CRT block). This block interacts with information through convolutional operations and a novel Manhattan self-attention (MaSA) mechanism. Finally, to dynamically aggregate the most informative features, a selective fusion module (MSF) integrates the multiscale features from all stages for the final classification task. On the public BUSI and our B-UCLM datasets, the MS-CRTU model achieves accuracies of 95.38% and 93.85% respectively, outperforming baseline models in F1 score and area under the curve (AUC). This study confirms that the proposed MS-CRTU enhances the accuracy and robustness of BUSI classification, offering a new approach for intelligent diagnosis of BUSIs.
Keywords:
attention mechanism
breast ultrasound
deep learning
image classification
multiscale fusion

Journal

International Journal of Imaging Systems and Technology cover
International Journal of Imaging Systems and Technology
IF:
2.5
Papers:
2.1K
Citations:
2.3K

Organization

G
Guangdong University of Finance and Economics
Scholars:
211
Papers: 147
Citations: 28
T
the first affiliated hospital of jinan university
Scholars:
65
Papers: 32
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers