arrow
Return

Evaluating Cellularity Estimation Methods: Comparing AI Counting with Pathologists' Visual Estimates

delete2024-05-28
delete0
delete
OA
AI
T
Tomoharu Kiyuna *
E
Eric Cosatto
K
Kanako C. Hatanaka *
T
Tomoyuki Yokose
K
Koji Tsuta
N
Noriko Motoi
K
Keishi Makita
A
A. Shimizu
T
Toshiya Shinohara
A
Akira Suzuki
E
Emi Takakuwa
Y
Yasunari Takakuwa
T
Takahiro Tsuji
M
Mitsuhiro Tsujiwaki
M
Mitsuru Yanai
S
Sayaka Yuzawa
M
Maki Ogura
Y
Yutaka Hatanaka
DOI:10.3390/diagnostics14111115delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The development of next-generation sequencing (NGS) has enabled the discovery of cancer-specific driver gene alternations, making precision medicine possible. However, accurate genetic testing requires a sufficient amount of tumor cells in the specimen. The evaluation of tumor content ratio (TCR) from hematoxylin and eosin (H&E)-stained images has been found to vary between pathologists, making it an important challenge to obtain an accurate TCR. In this study, three pathologists exhaustively labeled all cells in 41 regions from 41 lung cancer cases as either tumor, non-tumor or indistinguishable, thus establishing a gold standard TCR. We then compared the accuracy of the TCR estimated by 13 pathologists based on visual assessment and the TCR calculated by an AI model that we have developed. It is a compact and fast model that follows a fully convolutional neural network architecture and produces cell detection maps which can be efficiently post-processed to obtain tumor and non-tumor cell counts from which TCR is calculated. Its raw cell detection accuracy is 92% while its classification accuracy is 84%. The results show that the error between the gold standard TCR and the AI calculation was significantly smaller than that between the gold standard TCR and the pathologist's visual assessment (p<0.05). Additionally, the robustness of AI models across institutions is a key issue and we demonstrate that the variation in AI was smaller than that in the average of pathologists when evaluated by institution. These findings suggest that the accuracy of tumor cellularity assessments in clinical workflows is significantly improved by the introduction of robust AI models, leading to more efficient genetic testing and ultimately to better patient outcomes.
Keywords:
tumor content ratio (TCR)
next generation sequencing (NGS)
artificial intelligence (AI)
U-Net model
domain shift
site dependency
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Diagnostics cover
Diagnostics
IF:
3.3
Papers:
1.9W
Citations:
3.6W

Organization

T
Teine Keijinkai Hospital
Scholars:
725
Papers: 601
Citations: 397
K
kanagawa prefectural cancer center
Scholars:
1.4K
Papers: 1.4K
Citations: 2
K
Kansai Medical University
Scholars:
2.8K
Papers: 2.2K
Citations: 1.8K
S
Sapporo Medical University
Scholars:
4.1K
Papers: 2.6K
Citations: 15
A
asahikawa medical college
Scholars:
1.8K
Papers: 1.4K
Citations: 0
S
Sapporo City General Hospital
Scholars:
475
Papers: 342
Citations: 148
H
Hokkaido University
Scholars:
3.6W
Papers: 2.5W
Citations: 2.6W
N
nec corporation
Scholars:
1.0K
Papers: 953
Citations: 0
researcher View more organizations