.png){kind=icon}
返回
Few-shot biomedical image segmentation using diffusion models: Beyond image generation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.cmpb.2023.107832.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Background: Medical image analysis pipelines often involve segmentation, which requires a large amount of annotated training data, which is time-consuming and costly. To address this issue, we proposed leveraging generative models to achieve few-shot image segmentation. Methods: We trained a denoising diffusion probabilistic model (DDPM) on 480,407 pelvis radiographs to generate 256 x 256 px synthetic images. The DDPM was conditioned on demographic and radiologic characteristics and was rigorously validated by domain experts and objective image quality metrics (Frechet inception distance [FID] and inception score [IS]). For the next step, three landmarks (greater trochanter [GT], lesser trochanter [LT], and obturator foramen [OF]) were annotated on 45 real-patient radiographs; 25 for training and 20 for testing. To extract features, each image was passed through the pre-trained DDPM at three timesteps and for each pass, features from specific blocks were extracted. The features were concatenated with the real image to form an image with 4225 channels. The feature-set was broken into random patches, which were fed to a U-Net. Dice Similarity Coefficient (DSC) was used to compare the performance with a vanilla U-Net trained on radiographs.Results: Expert accuracy was 57.5 % in determining real versus generated images, while the model reached an FID = 7.2 and IS = 210. The segmentation UNet trained on the 20 feature-sets achieved a DSC of 0.90, 0.84, and 0.61 for OF, GT, and LT segmentation, respectively, which was at least 0.30 points higher than the naively trained model. Conclusion: We demonstrated the applicability of DDPMs as feature extractors, facilitating medical image segmentation with few annotated samples.
Keyword:
Generative AI
Diffusion models
Synthetic data
Semantic segmentation
Pelvis radiographs
Orthopedics surgery
期刊
IF:
4.8
论文数:
7.0K
被引数:
2.1W
机构
引用论文
分享收藏The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking伏隔核多巴胺在动机行为中的作用: 一种统一的解释，特别涉及寻求奖励
PREAI
分享收藏Relation between Stem Growth Processes and Internode Length Patterns in Sorghum Cultivar ‘Kazetachi’
OAAI
OAAI分享收藏Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis非监督: 医学图像分析中的半监督，多实例和迁移学习的调查.png)
MEDICAL IMAGE ANALYSISOAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏
查看更多内容