arrow
Return

Instance-Aware Multi-Task Learning for Nuclei Segmentation

delete2025-06-25
delete0
PRE
AI
W
Wei Lou
H
Haofeng Li
G
Guanbin Li
X
Xiaoying Lou
Y
Yuanhuan Xiong
X
Xiang Wan
X
Xusheng Wu
DOI:10.1109/TMI.2025.3583014delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Nuclei segmentation is critical for computational pathology analysis. Most previous methods employ pixel-wise classification or regression for automatic nuclei segmentation, without describing nucleus instances as individual entities at the feature level. To address the above limitation, we propose an instance-aware multi-task learning framework that strengthens a pixel-wise prediction branch with an instance-wise prediction branch. The instance-wise prediction branch leverages learnable cell-level queries, enabling the model to capture positional information and visual representations for individual nuclei. Concretely, we introduce an instance-disentangling feature learning module that effectively aligns the embeddings of the object-level queries with pixel-wise decoder features from the first branch. Further, we design a dual-branch unified post-processing algorithm that aggregates the complementary outputs of both branches for computing the instance segmentation results. Experimental results demonstrate that our framework achieves competitive performance on a wide range of nuclei segmentation benchmarks. The code and model weights are released in https://github.com/lhaof/IML
Keywords:
Nuclei segmentation
multi-task learning
transformer models
instance segmentation

Journal

IEEE Transactions on Medical Imaging cover
IEEE Transactions on Medical Imaging
IF:
9.8
Papers:
6.3K
Citations:
3.7W

Organization

S
sun yat-sen university
Scholars:
1.9W
Papers: 6.4K
Citations: 14
researcher View more organizations
Cited Papers

Cited Papers

Masked-attention Mask Transformer for Universal Image Segmentation
err2022-06-01
err0
errOAAI
errBowen Cheng; Ishan Misra; Alexander G. Schwing; Alexander Kirillov; Rohit Girdhar
errShare
errSave
Structure Embedded Nucleus Classification for Histopathology Images
err2024-09-01
err2
errOAAI
errLou, Wei; Wan, Xiang; Li, Guanbin; Lou, Xiaoying; Li, Chenghang; Gao, Feng; Li, Haofeng
errShare
errSave
End-to-End Object Detection with Transformers
err2020-11-03
err0
PREAI
errNicolas Carion; Francisco Massa; Gabriel Synnaeve; Nicolas Usunier; Alexander Kirillov; Sergey Zagoruyko
errShare
errSave
Cascade-DETR: Delving into High-Quality Universal Object Detection
err2023-10-01
err0
errOAAI
errMingqiao Ye; Lei Ke; Siyuan Li; Yu-Wing Tai; Chi-Keung Tang; Martin Danelljan; Fisher Yu
errShare
errSave
Panoptic Segmentation
err2019-06-01
err0
PREAI
errAlexander Kirillov; Kaiming He; Ross Girshick; Carsten Rother; Piotr Dollar
errShare
errSave
researcher View more