返回
Simultaneously segmenting and classifying cell nuclei by using multi-task learning in multiplex immunohistochemical tissue microarray sections
DOI:10.1016/j.bspc.2024.106143.png)
摘要
En 中文
Quantitative analysis of tumor immune microenvironment (TIME) in immunohistochemical (IHC) tissue microarray (TMA) sections is crucial in diagnosis and treatment recommendations for cancer patients. Nuclei segmentation and classification are the prerequisites for the TIME quantification, but it still lacks of robust nuclear quantification models used for IHC histological slides. In this paper, we design an approach for simultaneously segmenting and classifying cell nuclei in multiplex IHC TMA sections. The large TMA tissue core is first divided into a set of small overlapping patches, where cell nuclei are then simultaneously segmented and classified by using our multi-task learning model. The model has one feature encoder with cascaded separableResUnit blocks, and three decoder branches that incorporate the Self-Attention modules and DenseUnit blocks to perform nuclear segmentation, classification and distance map regression, respectively. After processing all patches, the weighted loss map and vote mechanism are applied to seamlessly stitch patch-level predictions to form the tissue core level results. We finally exploit generalized Laplacian of Gaussian (gLoG) filters based algorithm to post-process segmentation results to further split overlapping cell nuclei. Quantitative evaluations have been performed on a IHC stained histological image dataset with 9725 manually identified cell nuclei and a public H&E stained dataset (CoNSep), which show that our model outperforms state-of-the-art nuclei segmentation and classification models. The qualitative evaluations on TMA sections show the potential of using our approach in clinical applications.
Keyword:
Nuclei segmentation and classification
Self-Attention mechanism
Depth-wise separable convolution
Tissue microarray sections
期刊
IF:
4.9
论文数:
1.0W
被引数:
2.4W
机构
引用论文
Recent Development of Dual-Dictionary Learning Approach in Medical Image Analysis and Reconstruction
Distant regulatory elements in a Sox10‐βGEO BAC transgene are required for expression of Sox10 in the enteric nervous system and other neural crest‐derived tissuesSox10-βgeo BAC转基因中的远距离调控元件是肠神经系统和其他神经源性组织中 Sox10 表达所必需的
QuPath: Open source software for digital pathology image analysisQuPath: 用于数字病理图像分析的开源软件
SCIENTIFIC REPORTS
IF3.9
Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology imagesHover-Net: 多组织组织学图像中细胞核的同时分割和分类
MEDICAL IMAGE ANALYSIS
IF11.8
TSFD-Net: Tissue specific feature distillation network for nuclei segmentation and classification
NEURAL NETWORKS
IF6.3

