.png){kind=icon}
返回
Explainable Intermodality Medical Information Transfer Using Siamese Autoencoders
.png){kind=icon}
OA
AI
DOI：10.1109/TRPMS.2025.3577309.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Medical imaging fusion combines complementary information from multiple modalities to enhance diagnostic accuracy. However, evaluating the quality of fused images remains challenging, with many studies relying solely on classification performance, which may lead to incorrect conclusions. We introduce a novel framework for improving image fusion, focusing on preserving fine-grained details. Our model uses a siamese autoencoder to process T1-MRI and FDG-PET images in the context of Alzheimer’s disease (AD). The framework optimizes fusion by minimizing reconstruction error between generated and input images, while maximizing differences between modalities through cosine distance. Additionally, we propose a supervised variant, incorporating binary cross-entropy loss between diagnostic labels and probabilities. Fusion quality is rigorously assessed through three tests: 1) classification of AD patients and controls using fused images; 2) an atlas-based occlusion test for identifying regions relevant to cognitive decline; and 3) analysis of structural–functional relationships via Euclidean distance. Results show an AUC of 0.92 for AD detection, reveal the involvement of brain regions linked to preclinical AD stages, and demonstrate preserved structural–functional brain networks, indicating that subtle differences are successfully captured through our fusion approach.
Keyword:
Alzheimer’s disease (AD)
autoencoder
explainable deep learning (DL)
imaging transfer information
occlusion test
siamese network
期刊
I
IF:
3.5
论文数:
156
被引数:
2.0K
机构
引用论文
.png){kind=icon}
HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer’s diseaseHAMMF：基于层次化注意力机制的多任务和多模态融合模型，用于阿尔茨海默病计算机辅助诊断
PREAI
分享收藏Explainable Deep-Learning-Based Diagnosis of Alzheimer’s Disease Using Multimodal Input Fusion of PET and MRI Images使用PET和MRI图像的多模态输入融合可解释的基于深度学习的阿尔茨海默氏病诊断OAAI
OAAI分享收藏Deep learning-based classification of healthy aging controls, mild cognitive impairment and Alzheimer's disease using fusion of MRI-PET imaging使用mri-pet成像融合技术对健康衰老对照，轻度认知障碍和阿尔茨海默氏病进行基于深度学习的分类
PREAI
分享收藏
查看更多内容