.png){kind=icon}
返回
A multi-resolution self-supervised learning framework for semantic segmentation in histopathology
.png){kind=icon}
OA
AI
DOI：10.1016/j.patcog.2024.110621.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Modern whole slide imaging technique together with supervised deep learning approaches have been advancing the field of histopathology, enabling accurate analysis of tissues. These approaches use whole slide images (WSIs) at various resolutions, utilising low-resolution WSIs to identify regions of interest in the tissue and high -resolution for detailed analysis of cellular structures. Due to the labour -intensive process of annotating gigapixels WSIs, accurate analysis of WSIs remains challenging for supervised approaches. Self-supervised learning (SSL) has emerged as an approach to build efficient and robust models using unlabelled data. It has been successfully used to pre-train models to learn meaningful image features which are then fine-tuned with downstream tasks for improved performance compared to training models from scratch. Yet, existing SSL methods optimised for WSI are unable to leverage the multi -resolutions and instead, work only in an individual resolution neglecting the hierarchical structure of multi -resolution inputs. This limitation prevents from the effective utilisation of complementary information between different resolutions, hampering discriminative WSI representation learning. In this paper we propose a Multi -resolution SSL Framework for WSI semantic segmentation (MSF-WSI) that effectively learns histopathological features. Our MSF-WSI learns complementary information from multiple WSI resolutions during the pre -training stage; this contrasts with existing works that only learn between the resolutions at the fine-tuning stage. Our pre -training initialises the model with a comprehensive understanding of multi -resolution features which can lead to improved performance in the subsequent tasks. To achieve this, we introduced a novel Context-Target Fusion Module (CTFM) and a masked jigsaw pretext task to facilitate the learning of multi -resolution features. Additionally, we designed Dense SimSiam Learning (DSL) strategy to maximise the similarities of image features from early model layers to enable discriminative learned representations. We evaluated our method using three public datasets on breast and liver cancer segmentation tasks. Our experiment results demonstrated that our MSF-WSI surpassed the accuracy of other state -of -the -art methods in downstream fine-tuning and semi-supervised settings.
Keyword:
Multi-resolution histopathology learning
Self-supervised learning
Semantic segmentation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Sparse autoencoder for unsupervised nucleus detection and representation in histopathology images用于组织病理学图像中无监督核检测和表示的稀疏自动编码器.png)
PATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏Introducing instance label correlation in multiple instance learning. Application to cancer detection on histopathological images在多实例学习中引入实例标签相关性。组织病理学图像在癌症检测中的应用PATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏DCAN: Deep contour-aware networks for object instance segmentation from histology imagesDban: 用于从组织学图像中分割对象实例的深度轮廓感知网络MEDICAL IMAGE ANALYSIS
MEDICAL IMAGE ANALYSISIF11.8
PREAI
分享收藏Segmentation of glandular epithelium in colorectal tumours to automatically compartmentalise IHC biomarker quantification: A deep learning approachMEDICAL IMAGE ANALYSIS
MEDICAL IMAGE ANALYSISIF11.8
PREAI
分享收藏Self-supervised driven consistency training for annotation efficient histopathology image analysis用于注释高效组织病理学图像分析的自监督驱动一致性训练MEDICAL IMAGE ANALYSIS
OAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏Detection and classification of cancer in whole slide breast histopathology images using deep convolutional networks基于深度卷积网络的全载玻片乳腺组织病理学图像中癌症的检测与分类PATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏
查看更多内容