.png){kind=icon}
返回
TransDiff: medical image segmentation method based on Swin Transformer with diffusion probabilistic model
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-024-05496-w.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Medical image segmentation can provide a reliable basis for clinical analysis and diagnosis. However, this task is challenging due to the low contrast, boundary ambiguity between organs or lesions and surrounding tissues, and noise interference of images. To address this challenge, which is unique to medical images, and further improve the segmentation accuracy and precision, a medical image segmentation model (TransDiff) is proposed from the perspective of improving model robustness and enriching semantic information. TransDiff comprises three parts: a variational autoencoder (VAE), a diffusion transformer model and a Swin Transformer. The VAE constructs a latent space to provide an environment for fully extracting and fusing features. The diffusion model predicts and removes noise by inferring semantics through the propagation of information between nodes. The Swin Transformer enriches discriminative features as a conditional part. TransDiff inherits the robustness to noise and missing data of the diffusion model and the feature enrichment of the Swin Transformer, thus exhibiting a higher understanding of semantic information. It performs well on medical datasets with three different image modalities, outperforms existing medical image segmentation methods in terms of segmentation precision and accuracy, and has good generalizability. The codes and trained models will be publicly available at https://github.com/xiaoxiao1997/TransDiff.
Keyword:
Diffusion probabilistic model
Variational autoencoder
Transformer
Medical image segmentation
Deep learning
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Continuous wavelength tuning of InAs quantum dots on InP and substrates by chemical-beam epitaxy通过化学束外延法对InAs量子点在InP衬底上的连续波长调谐
PREAI
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
PREAI
分享收藏ST-Unet: Swin Transformer boosted U-Net with Cross-Layer Feature Enhancement for medical image segmentationSt-unet: Swin Transformer增强的u-net跨层特征增强医学图像分割
PREAI
分享收藏Continuous Fluid Resuscitation for Treatment of Uncontrolled Hemorrhagic Shock Following Massive Splenic Injury in Rats.png)
Shock
OAAI
ShockIF0
OAAI分享收藏
MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentationMultiusunnet: 重新思考多模态生物医学图像分割的u-net体系结构NEURAL NETWORKSOAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏Multi-instance learning based on spatial continuous category representation for case-level meningioma grading in MRI imagesAPPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
分享收藏
查看更多内容