.png){kind=icon}
返回
Compositionally Equivariant Representation Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TMI.2024.3358955.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep learning models often need sufficient supervision (i.e., labelled data) in order to be trained effectively. By contrast, humans can swiftly learn to identify important anatomy in medical images like MRI and CT scans, with minimal guidance. This recognition capability easily generalises to new images from different medical facilities and to new tasks in different settings. This rapid and generalisable learning ability is largely due to the compositional structure of image patterns in the human brain, which are not well represented in current medical models. In this paper, we study the utilisation of compositionality in learning more interpretable and generalisable representations for medical image segmentation. Overall, we propose that the underlying generative factors that are used to generate the medical images satisfy compositional equivariance property, where each factor is compositional (e.g., corresponds to human anatomy) and also equivariant to the task. Hence, a good representation that approximates well the ground truth factor has to be compositionally equivariant. By modelling the compositional representations with learnable von-Mises-Fisher (vMF) kernels, we explore how different design and learning biases can be used to enforce the representations to be more compositionally equivariant under un-, weakly-, and semi-supervised settings. Extensive results show that our methods achieve the best performance over several strong baselines on the task of semi-supervised domain-generalised medical image segmentation. Code will be made publicly available upon acceptance at https://github.com/vios-s.
Keyword:
Task analysis
Kernel
Image segmentation
Medical diagnostic imaging
Data models
Training
Heart
Compositional equivariance
compositionality
domain generalisation
representation learning
semi-supervised
weakly supervised
期刊
IF:
9.8
论文数:
6.3K
被引数:
3.7W
机构
引用论文
A cancer pharmacogenomic screen powering crowd-sourced advancement of drug combination prediction.png)
OAAI
IF0
OAAI分享收藏
查看更多内容