.png){kind=icon}
返回
Learning Cross-Modality Representations From Multi-Modal Images
.png){kind=icon}
OA
AI
DOI：10.1109/TMI.2018.2868977.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Machine learning algorithms can have difficulties adapting to data from different sources, for example from different imaging modalities. We present and analyze three techniques for unsupervised cross-modality feature learning, using a shared autoencoder-like convolutional network that learns a common representation from multi-modal data. We investigate a form of feature normalization, a learning objective that minimizes cross-modality differences, and modality dropout, in which the network is trained with varying subsets of modalities. We measure the same-modality and cross-modality classification accuracies and explore whether the models learn modality-specific or shared features. This paper presents experiments on two public data sets, with knee images from two MRI modalities, provided by the Osteoarthritis Initiative, and brain tumor segmentation on four MRI modalities from the BRATS challenge. All three approaches improved the cross-modality classification accuracy, with modality dropout and per-feature normalization giving the largest improvement. We observed that the networks tend to learn a combination of cross-modality and modality-specific features. Overall, a combination of all three methods produced the most cross-modality features and the highest cross-modality classification accuracy, while maintaining most of the same-modality accuracy.
Keyword:
Representation learning
transfer learning
autoencoders
deep learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.8
论文数:
6.3K
被引数:
3.7W
机构
引用论文
.png){kind=icon}
分享收藏
Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO基于多模态深度神经网络和稀疏组LASSO的异构特征选择OAAI
OAAI分享收藏
查看更多内容