arrow
Return

Report Supervision

delete2026-08-20
delete0
PRE
AI
P
Pedro R. A. S. Bassi
W
Wenxuan Li
J
Jakob Wasserthal
J
Jieneng Chen
X
Xinze Zhou
朱
朱哲人 (Zheren Zhu)
C
Chuntung Zhuang
S
Sergio Decherchi
A
Andrea Cavalli
K
Kang Wang
Y
Yang Yang
A
Alan Yuille
Z
Zongwei Zhou *
DOI:10.1016/j.media.2026.104257delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• Radiology reports directly supervise tumor segmentation training. • Volume Loss and Ball Loss teach segmentation models to segment tumors matching reports in tumor count, sizes, and locations. • Reports scale segmentation datasets when masks are few or many. • R-Super gains up to +15% F1-Score and DSC over mask-only training. • R-Super improves tumor detection at unseen external hospitals and for small tumors. Abstract Segmentation models can surpass radiologists, classification models, and vision–language models in tumor detection. Furthermore, segmentation models outline tumors, allowing radiologists to better verify and trust the AI output. However, their main limitation is the scarcity of tumor masks: creating one 3D tumor mask takes up to 30 min, so most public CT datasets contain only a few hundred masks, and even the largest private datasets contain only a couple of thousand. Tumor masks are not produced in clinical routine, but radiology reports are. Public datasets contain tens of thousands of CT-Report pairs, and hospitals contain hundreds of thousands. These reports describe tumors in detail, providing large-scale, informative training data. Here, we introduce Report Supervision (R-Super), a training framework that uses reports to directly supervise and improve tumor segmentation. R-Super introduces new loss functions that teach segmentation models to segment tumors that match report descriptions of tumor count, sizes, and locations. Reports are only used for training. We evaluated R-Super on kidney and pancreatic tumor segmentation, exploring diverse training data sizes, up to 41,418 CT-Report pairs plus 3488 CT-Mask pairs. On external validation, R-Super increased tumor detection F1-Score and segmentation DSC by up to +15% with respect to mask-only training. It also surpassed alternative methods such as CLIP and multi-task learning. It enabled pancreatic tumor detection on non-contrast CT without requiring tumor masks from non-contrast CT. In summary, by leveraging numerous readily available reports to supplement scarce masks, R-Super strongly improves AI performance when very few training masks are available (e.g., 50), and when many masks are available (e.g., 3488), unlocking scale in tumor segmentation. Project: https://github.com/MrGiovanni/R-Super.
Keywords:
Tumor detection
Tumor segmentation
Radiology reports
Weak supervision
Computed tomography

Journal

Medical Image Analysis cover
Medical Image Analysis
IF:
11.8
Papers:
3.9K
Citations:
2.4W

Organization

U
university hospital basel
Scholars:
1.2K
Papers: 394
Citations: 0
I
Italian Institute of Technology
Scholars:
237
Papers: 86
Citations: 0
J
johns hopkins university
Scholars:
1.1W
Papers: 4.1K
Citations: 1
U
University of California
Scholars:
9.7K
Papers: 3.6K
Citations: 8.3W
researcher View more organizations
Cited Papers

Cited Papers

Rubik's Cube plus : A self-supervised feature learning framework for 3D medical image analysis
err2020-08-01
err105
PREAI
errZhu, Jiuwen; Li, Yuexiang; Hu, Yifan; Ma, Kai; Zhou, S. Kevin; Zheng, Yefeng
errShare
errSave
3D Multi-Attention Guided Multi-Task Learning Network for Automatic Gastric Tumor Segmentation and Lymph Node Classification
err2021-06-01
err79
PREAI
errZhang, Yongtao; Li, Haimei; Du, Jie; Qin, Jing; Wang, Tianfu; Chen, Yue; Liu, Bing; Gao, Wenwen; Ma, Guolin; Lei, Baiying
errShare
errSave
Helical CT of renal masses: the value of delayed scans.
err1996-09-01
err0
PREAI
errR K Zeman; A Zeiberg; W S Hayes; P M Silverman; C Cooper; B S Garra
errShare
errSave
Large-scale pancreatic cancer detection via non-contrast CT and deep learning
err2023-11-20
err45
errOAAI
errCao, Kai; Xia, Yingda; Yao, Jiawen; Han, Xu; Lambert, Lukas; Zhang, Tingting; Tang, Wei; Jin, Gang; Jiang, Hui; Fang, Xu; Nogues, Isabella; Li, Xuezhou; Guo, Wenchao; Wang, Yu; Fang, Wei; Qiu, Mingyan; Hou, Yang; Kovarnik, Tomas; Vocka, Michal; Lu, Yimei; Chen, Yingli; Chen, Xin; Liu, Zaiyi; Zhou, Jian; Xie, Chuanmiao; Zhang, Rong; Lu, Hong; Hager, Gregory D.; Yuille, Alan L.; Lu, Le; Shao, Chengwei; Shi, Yu; Zhang, Qi; Liang, Tingbo; Zhang, Ling; Lu, Jianping
errShare
errSave
AbdomenAtlas: A large-scale, detailed-annotated, & multi-center dataset for efficient transfer learning and open algorithmic benchmarking
err2024-10-01
err0
PREAI
errLi, Wenxuan; Qu, Chongyu; Chen, Xiaoxi; Bassi, Pedro R. A. S.; Shi, Yijia; Lai, Yuxiang; Yu, Qian; Xue, Huimin; Chen, Yixiong; Lin, Xiaorui; Tang, Yutong; Cao, Yining; Han, Haoqi; Zhang, Zheyuan; Liu, Jiawei; Zhang, Tiezheng; Ma, Yujiu; Wang, Jincheng; Zhang, Guang; Yuille, Alan; Zhou, Zongwei
errShare
errSave
Models Genesis
err2021-01-01
err169
errOAAI
errZhou, Zongwei; Sodha, Vatsal; Pang, Jiaxuan; Gotway, Michael B.; Liang, Jianming
errShare
errSave
New response evaluation criteria in solid tumours: Revised RECIST guideline (version 1.1)
err2009-01-01
err2.4W
PREAI
errEisenhauer, E. A.; Therasse, P.; Bogaerts, J.; Schwartz, L. H.; Sargent, D.; Ford, R.; Dancey, J.; Arbuck, S.; Gwyther, S.; Mooney, M.; Rubinstein, L.; Shankar, L.; Dodd, L.; Kaplan, R.; Lacombe, D.; Verweij, J.
errShare
errSave
Prevalence, features, and explanations of missed and misinterpreted pancreatic cancer on imaging: a matched case–control study
err2022-09-21
err0
errOAAI
errSanne A. Hoogenboom; Megan M. L. Engels; Anthony V. Chuprin; Jeanin E. van Hooft; Jordan D. LeGout; Michael B. Wallace; Candice W. Bolan
errShare
errSave
Reporting results of cancer treatment
err1981-01-01
err0
errOAAI
errA. B. Miller; B. Hoogstraten; M. Staquet; A. Winkler
errShare
errSave
DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks
err2017-02-01
err222
errOAAI
errRajchl, Martin; Lee, Matthew C. H.; Oktay, Ozan; Kamnitsas, Konstantinos; Passerat-Palmbach, Jonathan; Bai, Wenjia; Damodaram, Mellisa; Rutherford, Mary A.; Hajnal, Joseph V.; Kainz, Bernhard; Rueckert, Daniel
errShare
errSave
researcher View more