1
Return

Pathology-CoT: learning visual chain-of-thought agents from expert whole-slide image diagnosis behaviour

delete2026-07-24
delete0
PRE
AI
王胜 cover
王胜 (Sheng Wang)
R
Ruiming Wu
C
Charles Herndon
S
Songhao Li
Y
Yihang Liu
S
Shunsuke Koga
X
Xiaowei Xu
D
David E. Elder
J
Jonathan Alex Miles
A
Annie Jin
I
Ikuko Hirai
M
Meaghan Dougher
J
Jeanne Shen
Z
Zhi Huang *
DOI:10.1038/s41551-026-01739-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diagnosing a whole-slide image is an interactive, multistage process, yet practical agentic systems that navigate fields, adjust magnification and deliver explainable diagnoses remain lacking, largely because the tacit, experience-based viewing behaviour of expert pathologists is absent from model training data. Here we introduce Pathology-CoT, a framework that converts expert viewing chain-of-thought behaviour into scalable agent supervision through three contributions. First, an artificial intelligence session recorder unobtrusively captures routine navigation in standard whole-slide image viewers and converts raw logs into standardized behavioural commands and bounding boxes. Second, a human-in-the-loop review pipeline turns artificial intelligence-drafted rationales into paired ‘where to look’ and ‘why it matters’ supervision, enabling sixfold faster labelling. Third, using these data, we built Pathology-o3, a two-stage agent that proposes regions of interest and performs behaviour-guided reasoning. On gastrointestinal lymph node metastasis detection, Pathology-o3 outperformed state-of-the-art vision–language models, showed consistent gains across multiple vision–language model backbones and maintained strong performance on an independent external validation cohort. Pathology-CoT converts routine viewing logs into task-conditioned behavioural supervision paired with expert-verified reasoning, supplying the supervision required for the development of Pathology-o3, a human-aligned agent for digital pathology.

Journal

Nature Biomedical Engineering cover
Nature Biomedical Engineering
IF:
26.6
Papers:
1.7K
Citations:
2.0W

Organization

U
University of Pennsylvania
Scholars:
1.0W
Papers: 3.6K
Citations: 11.8W
S
stanford university
Scholars:
9.2K
Papers: 3.6K
Citations: 0
U
University of California
Scholars:
7.3K
Papers: 2.8K
Citations: 8.3W
Cited Papers

Cited Papers

Citing Papers

Citing Papers