arrow
返回

Instance-level semantic segmentation of nuclei based on multimodal structure encoding

delete2025-02-06
delete0
delete
OA
AI
B
Bo Guan
G
Guangdi Chu
Z
Ziying Wang
李建敏 封面图
李建敏 (Jianmin Li) *
B
Bo Yi *
DOI:10.1186/s12859-025-06066-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
背景准确分割和分类细胞核对于组织病理学图像分析至关重要。然而,现有的基于深度神经网络的方法由于其依赖局部感受野,往往难以捕捉细胞核的复杂形态学特征和全局空间分布。 方法本研究提出了一种基于视觉-语言模型的图神经网络编码框架。该框架包括:(1) 利用对比语言-图像预训练(CLIP)模型图像编码器的多尺度特征融合与知识蒸馏模块;(2) 将细胞形态学特征转换为文本描述以进行语义表示的方法;以及(3) 采用图神经网络方法学习细胞核之间的空间关系和上下文信息。 结果实验结果表明,与现有方法相比,所提出的方法显著提高了细胞核分割和分类的准确性。该框架有效捕获了复杂的核结构及全局分布特征,从而提升了组织病理学图像分析的性能。 结论通过深度挖掘细胞核的形态学特征及其空间拓扑关系,本研究的图神经网络编码框架实现了高精度的核分割和分类。该方法在增强组织病理学图像分析方面展现出显著潜力,有望实现更准确的诊断,并加深对病理组织中细胞结构的理解。
Keyword:
Cell nucleus segmentation
Histopathological image
Graph neural networks
Multimodal fusion

期刊

BMC Bioinformatics 封面图
BMC Bioinformatics
IF:
3.3
论文数:
666
被引数:
5.2W

机构

暂无机构信息
引用论文

引用论文

Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer深度学习可以直接从胃肠道肿瘤的组织学中预测微卫星不稳定性
err2019-06-03
err761
errOAAI
errKather, Jakob Nikolas; Pearson, Alexander T.; Halama, Niels; Jaeger, Dirk; Krause, Jeremias; Loosen, Sven H.; Marx, Alexander; Boor, Peter; Tacke, Frank; Neumann, Ulf Peter; Grabsch, Heike I.; Yoshikawa, Takaki; Brenner, Hermann; Chang-Claude, Jenny; Hoffmeister, Michael; Trautwein, Christian; Luedde, Tom
err分享
err收藏
Single-cell protein activity analysis identifies recurrence-associated renal tumor macrophages单细胞蛋白活性分析鉴定与复发相关的肾肿瘤巨噬细胞
errCell
IF0
err2021-05-01
err0
errOAAI
errAleksandar Obradovic; Nivedita Chowdhury; Scott M. Haake; Casey Ager; Vinson Wang; Lukas Vlahos; Xinzheng V. Guo; David H. Aggen; W. Kimryn Rathmell; Eric Jonasch; Joyce E. Johnson; Marc Roth; Kathryn E. Beckermann; Brian I. Rini; James McKiernan; Andrea Califano; Charles G. Drake
err分享
err收藏
HoVer-Trans: Anatomy-Aware HoVer-Transformer for ROI-Free Breast Cancer Diagnosis in Ultrasound ImagesHoVer-Trans: 用于超声图像中无ROI乳腺癌诊断的解剖感知悬停变压器
err2023-06-01
err30
errOAAI
errMo, Yuhao; Han, Chu; Liu, Yu; Liu, Min; Shi, Zhenwei; Lin, Jiatai; Zhao, Bingchao; Huang, Chunwang; Qiu, Bingjiang; Cui, Yanfen; Wu, Lei; Pan, Xipeng; Xu, Zeyan; Huang, Xiaomei; Li, Zhenhui; Liu, Zaiyi; Wang, Ying; Liang, Changhong
err分享
err收藏
Segment anything model for medical images?分割医学图像的任何模型?
err2024-02-01
err66
errOAAI
errHuang, Yuhao; Yang, Xin; Liu, Lian; Zhou, Han; Chang, Ao; Zhou, Xinrui; Chen, Rusi; Yu, Junxuan; Chen, Jiongquan; Chen, Chaoyu; Liu, Sijing; Chi, Haozhe; Hu, Xindi; Yue, Kejuan; Li, Lei; Grau, Vicente; Fan, Deng-Ping; Dong, Fajin; Ni, Dong
err分享
err收藏
Panoptic Segmentation
err2019-06-01
err0
PREAI
errAlexander Kirillov; Kaiming He; Ross Girshick; Carsten Rother; Piotr Dollar
err分享
err收藏
Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology imagesHover-Net: 多组织组织学图像中细胞核的同时分割和分类
err2019-12-01
err661
errOAAI
errGraham, Simon; Quoc Dang Vu; Raza, Shan E. Ahmed; Azam, Ayesha; Tsang, Yee Wah; Kwak, Jin Tae; Rajpoot, Nasir
err分享
err收藏
Progressive immune dysfunction with advancing disease stage in renal cell carcinoma
err2021-05-01
err0
errOAAI
errDavid A. Braun; Kelly Street; Kelly P. Burke; David L. Cookmeyer; Thomas Denize; Christina B. Pedersen; Satyen H. Gohil; Nicholas Schindler; Lucas Pomerance; Laure Hirsch; Ziad Bakouny; Yue Hou; Juliet Forman; Teddy Huang; Shuqiang Li; Ang Cui; Derin B. Keskin; John Steinharter; Gabrielle Bouchard; Maxine Sun; Erica M. Pimenta; Wenxin Xu; Kathleen M. Mahoney; Bradley A. McGregor; Michelle S. Hirsch; Steven L. Chang; Kenneth J. Livak; David F. McDermott; Sachet A. Shukla; Lars R. Olsen; Sabina Signoretti; Arlene H. Sharpe; Rafael A. Irizarry; Toni K. Choueiri; Catherine J. Wu
err分享
err收藏
Automatic Nuclei Segmentation in H&E Stained Breast Cancer Histopathology Images
err2013-07-29
err0
errOAAI
errMitko Veta; Paul J. van Diest; Robert Kornegoor; André Huisman; Max A. Viergever; Josien P. W. Pluim
err分享
err收藏
学者 查看更多内容