arrow
返回

Simultaneously segmenting and classifying cell nuclei by using multi-task learning in multiplex immunohistochemical tissue microarray sections

delete2024-07-01
delete1
PRE
AI
R
Ranran Wang
Y
Yusong Qiu
X
Xinyu Hao
S
Shan Jin
J
Junxiu Gao
H
Heng Qi
徐齐 封面图
徐齐 (Qi Xu)
Y
Yong Zhang *
H
Hongming Xu *
DOI:10.1016/j.bspc.2024.106143delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Quantitative analysis of tumor immune microenvironment (TIME) in immunohistochemical (IHC) tissue microarray (TMA) sections is crucial in diagnosis and treatment recommendations for cancer patients. Nuclei segmentation and classification are the prerequisites for the TIME quantification, but it still lacks of robust nuclear quantification models used for IHC histological slides. In this paper, we design an approach for simultaneously segmenting and classifying cell nuclei in multiplex IHC TMA sections. The large TMA tissue core is first divided into a set of small overlapping patches, where cell nuclei are then simultaneously segmented and classified by using our multi-task learning model. The model has one feature encoder with cascaded separableResUnit blocks, and three decoder branches that incorporate the Self-Attention modules and DenseUnit blocks to perform nuclear segmentation, classification and distance map regression, respectively. After processing all patches, the weighted loss map and vote mechanism are applied to seamlessly stitch patch-level predictions to form the tissue core level results. We finally exploit generalized Laplacian of Gaussian (gLoG) filters based algorithm to post-process segmentation results to further split overlapping cell nuclei. Quantitative evaluations have been performed on a IHC stained histological image dataset with 9725 manually identified cell nuclei and a public H&E stained dataset (CoNSep), which show that our model outperforms state-of-the-art nuclei segmentation and classification models. The qualitative evaluations on TMA sections show the potential of using our approach in clinical applications.
Keyword:
Nuclei segmentation and classification
Self-Attention mechanism
Depth-wise separable convolution
Tissue microarray sections

期刊

Biomedical Signal Processing and Control 封面图
Biomedical Signal Processing and Control
IF:
4.9
论文数:
1.0W
被引数:
2.4W

机构

U
university of jyvaskyla
学者数:
6.3K
论文数: 6.8K
被引数: 12
D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
引用论文

引用论文

Towards Automatic Protein Co-Expression Quantification in Immunohistochemical TMA Slides
err2021-02-01
err6
errOAAI
errSolorzano, Leslie; Pereira, Carla; Martins, Diana; Almeida, Raquel; Carneiro, Fatima; Almeida, Gabriela M.; Oliveira, Carla; Wahlby, Carolina
err分享
err收藏
Imagery, Affect, and Decision Making
err1998-01-01
err0
errOAAI
errPaul Slovic; Donald G. MacGregor; Ellen Peters
err分享
err收藏
QuPath: Open source software for digital pathology image analysisQuPath: 用于数字病理图像分析的开源软件
err2017-12-04
err4.8K
errOAAI
errBankhead, Peter; Loughrey, Maurice B.; Fernandez, Jose A.; Dombrowski, Yvonne; Mcart, Darragh G.; Dunne, Philip D.; McQuaid, Stephen; Gray, Ronan T.; Murray, Liam J.; Coleman, Helen G.; James, Jacqueline A.; Salto-Tellez, Manuel; Hamilton, Peter W.
err分享
err收藏
Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology imagesHover-Net: 多组织组织学图像中细胞核的同时分割和分类
err2019-12-01
err661
errOAAI
errGraham, Simon; Quoc Dang Vu; Raza, Shan E. Ahmed; Azam, Ayesha; Tsang, Yee Wah; Kwak, Jin Tae; Rajpoot, Nasir
err分享
err收藏
TSFD-Net: Tissue specific feature distillation network for nuclei segmentation and classification
err2022-07-01
err30
errOAAI
errIlyas, Talha; Mannan, Zubaer Ibna; Khan, Abbas; Azam, Sami; Kim, Hyongsuk; De Boer, Friso
err分享
err收藏
NucleiSegNet: Robust deep learning architecture for the nuclei segmentation of liver cancer histopathology images
err2021-01-01
err106
PREAI
errLal, Shyam; Das, Devikalyan; Alabhya, Kumar; Kanfade, Anirudh; Kumar, Aman; Kini, Jyoti
err分享
err收藏
学者 查看更多内容