arrow
Return

Task Decomposition and Synchronization for Semantic Biomedical Image Segmentation

delete2020-01-01
delete19
delete
OA
AI
X
Xuhua Ren
S
Sahar Ahmad
Z
Zhang, Lichi
L
Lei Xiang
D
Dong Nie
Y
Yang, Fan
王茜 cover
王茜 (Qian Wang) *
D
Dinggang Shen *
DOI:10.1109/TIP.2020.3003735delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Semantic segmentation is essentially important to biomedical image analysis. Many recent works mainly focus on integrating the Fully Convolutional Network (FCN) architecture with sophisticated convolution implementation and deep supervision. Such complex networks need large training datasets, a requirement which is challenging for medical image analysis. In this paper, we propose to decompose the single segmentation task into three subsequent sub-tasks, including (1) pixel-wise image semantic segmentation, (2) prediction of the instance class labels of the objects within the image, and (3) classification of the scene the image belonging to. While these three sub-tasks are trained to optimize their individual loss functions at different perceptual levels, we propose to allow their interaction within the task-task context ensemble. Moreover, we propose a novel sync-regularization to penalize the deviation between the outputs of the pixel-wise semantic segmentation and the instance class prediction tasks. These effective regularizations help FCN utilize context information comprehensively and attain accurate segmentation, even though the number of images for training may be limited in many biomedical applications. We have successfully applied our framework to three diverse 2D/3D medical image datasets, including Robotic Scene Segmentation Challenge 18 (ROBOT18), Brain Tumor Segmentation Challenge 18 (BRATS18), and Retinal Fundus Glaucoma Challenge (REFUGE18). We have achieved outperformed or comparable performance in all the three challenges. Our code, typical data and trained models are available at https://github.com/xuhuaren/TDSNet.
Keywords:
Semantic segmentation
fully convolutional network
task decomposition
sync-regularization
deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

K
Korea University
Scholars:
3.6W
Papers: 3.8W
Citations: 4.4W
S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
U
university of north carolina
Scholars:
7.4W
Papers: 6.5W
Citations: 93
U
University of North Carolina Chapel Hill
Scholars:
3.9W
Papers: 3.1W
Citations: 46
researcher View more organizations