arrow
返回

Context Label Learning: Improving Background Class Representations in Semantic Segmentation

delete2023-06-01
delete1
delete
OA
AI
李
李泽榉 (Zeju Li) *
K
Konstantinos Kamnitsas
C
Cheng Ouyang
陈
陈晨 (Chen Chen)
B
Ben Glocker
DOI:10.1109/TMI.2023.3242838delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Background samples provide key contextual information for segmenting regions of interest (ROIs). However, they always cover a diverse set of structures, causing difficulties for the segmentation model to learn good decision boundaries with high sensitivity and precision. The issue concerns the highly heterogeneous nature of the background class, resulting in multi-modal distributions. Empirically, we find that neural networks trained with heterogeneous background struggle to map the corresponding contextual samples to compact clusters in feature space. As a result, the distribution over background logit activations may shift across the decision boundary, leading to systematic over-segmentation across different datasets and tasks. In this study, we propose context label learning (CoLab) to improve the context representations by decomposing the background class into several subclasses. Specifically, we train an auxiliary network as a task generator, along with the primary segmentation model, to automatically generate context labels that positively affect the ROI segmentation accuracy. Extensive experiments are conducted on several challenging segmentation tasks and datasets. The results demonstrate that CoLab can guide the segmentation model to map the logits of background samples away from the decision boundary, resulting in significantly improved segmentation accuracy. Code is available at https://github.com/ZerojumpLine/CoLab.
Keyword:
Image segmentation
Tumors
Task analysis
Liver
Kidney
Context modeling
Training
Underfitting
multi-task learning
self-supervised learning
image segmentation

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

I
Imperial College London
学者数:
8.3W
论文数: 7.3W
被引数: 11.1W
引用论文

引用论文

The Reliability of Physical Examination for Carpal Tunnel Syndrome
err1998-08-01
err0
PREAI
errR. G. MARX; P. L. HUDAK; C. BOMBARDIER; B. GRAHAM; C. GOLDSMITH; J. G. WRIGHT
err分享
err收藏
Robust whole-brain segmentation: Application to traumatic brain injury
err2015-04-01
err135
errOAAI
errLedig, Christian; Heckemann, Rolf A.; Hammers, Alexander; Lopez, Juan Carlos; Newcombe, Virginia F. J.; Makropoulos, Antonios; Loetjoenen, Jyrki; Menon, David K.; Rueckert, Daniel
err分享
err收藏
err分享
err收藏
An artificial intelligence framework for automatic segmentation and volumetry of vestibular schwannomas from contrast-enhanced T1-weighted and high-resolution T2-weighted MRI
err2021-01-01
err86
PREAI
errShapey, Jonathan; Wang, Guotai; Dorent, Reuben; Dimitriadis, Alexis; Li, Wenqi; Paddick, Ian; Kitchen, Neil; Bisdas, Sotirios; Saeed, Shakeel R.; Ourselin, Sebastien; Bradford, Robert; Vercauteren, Tom
err分享
err收藏
Browplasty as an adjunct to rhinoplasty
err2006-07-18
err0
PREAI
errRichard C. Webster; Terence M. Davidson; Richard C. Smith
err分享
err收藏
CT radiomics to predict high-risk intraductal papillary mucinous neoplasms of the pancreas
err2018-09-27
err84
errOAAI
errChakraborty, Jayasree; Midya, Abhishek; Gazit, Lior; Attiyeh, Marc; Langdon-Embry, Liana; Allen, Peter J.; Do, Richard K. G.; Simpson, Amber L.
err分享
err收藏
Survival Prediction in Pancreatic Ductal Adenocarcinoma by Quantitative Computed Tomography Image Analysis
err2018-01-29
err104
errOAAI
errAttiyeh, Marc A.; Chakraborty, Jayasree; Doussot, Alexandre; Langdon-Embry, Liana; Mainarich, Shiana; Gonen, Mithat; Balachandran, Vinod P.; D'Angelica, Michael I.; DeMatteo, Ronald P.; Jarnagin, William R.; Kingham, T. Peter; Allen, Peter J.; Simpson, Amber L.; Do, Richard K.
err分享
err收藏
Automatic pancreas segmentation based on lightweight DCNN modules and spatial prior propagation
err2021-06-01
err58
PREAI
errZhang, Dingwen; Zhang, Jiajia; Zhang, Qiang; Han, Jungong; Zhang, Shu; Han, Junwei
err分享
err收藏
学者 查看更多内容