.png){kind=icon}
返回
A visual-language foundation model for computational pathology
.png){kind=icon}
OA
AI
DOI：10.1038/s41591-024-02856-4.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The accelerated adoption of digital pathology and advances in deep learning have enabled the development of robust models for various pathology tasks across a diverse array of diseases and patient cohorts. However, model training is often difficult due to label scarcity in the medical domain, and a model's usage is limited by the specific task and disease for which it is trained. Additionally, most models in histopathology leverage only image data, a stark contrast to how humans teach each other and reason about histopathologic entities. We introduce CONtrastive learning from Captions for Histopathology (CONCH), a visual-language foundation model developed using diverse sources of histopathology images, biomedical text and, notably, over 1.17 million image-caption pairs through task-agnostic pretraining. Evaluated on a suite of 14 diverse benchmarks, CONCH can be transferred to a wide range of downstream tasks involving histopathology images and/or text, achieving state-of-the-art performance on histology image classification, segmentation, captioning, and text-to-image and image-to-text retrieval. CONCH represents a substantial leap over concurrent visual-language pretrained systems for histopathology, with the potential to directly facilitate a wide array of machine learning-based workflows requiring minimal or no further supervised fine-tuning. Developed using diverse sources of histopathology images, biomedical text and over 1.17 million image-caption pairs, evaluated on a suite of 14 diverse benchmarks, a visual-language foundation model achieves state-of-the-art performance on a wide array of clinically relevant pathology tasks.
Keyword:
ARTIFICIAL-INTELLIGENCE
CANCER
SYSTEM
期刊
IF:
50
论文数:
1.4W
被引数:
13.4W
机构
引用论文
The influence of various precursors on solar-light-driven g-C3N4 synthesis and its effect on photocatalytic tetracycline hydrochloride (TCH) degradation各种前体对太阳光驱动的g-C3N4合成及其对光催化盐酸四环素 (TCH) 降解的影响
PREAI
分享收藏Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networks使用深度神经网络对切除的肺腺癌载玻片上的组织学模式进行病理学家水平的分类.png)
SCIENTIFIC REPORTS
OAAI
SCIENTIFIC REPORTSIF3.9
OAAI分享收藏Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the PANDA challenge前列腺癌诊断和Gleason分级的人工智能: 熊猫挑战NATURE MEDICINEOAAI
NATURE MEDICINEIF50
OAAI分享收藏Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning基于深度学习的非小细胞肺癌组织病理图像分类及突变预测NATURE MEDICINEOAAI
NATURE MEDICINEIF50
OAAI分享收藏Clinical-grade computational pathology using weakly supervised deep learning on whole slide images在整个幻灯片图像上使用弱监督深度学习的临床级计算病理学NATURE MEDICINEOAAI
NATURE MEDICINEIF50
OAAI分享收藏The Role of CD80, CD86, and CTLA4 in Alloimmune Responses and the Induction of Long-Term Allograft SurvivalCD80，CD86和CTLA4在同种免疫反应中的作用以及诱导同种异体移植长期存活OAAI
OAAI分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏Data-efficient and weakly supervised computational pathology on whole-slide images全载玻片图像上的数据高效和弱监督计算病理学OAAI
OAAI分享收藏
查看更多内容