arrow
Return

Contour subregion error detection methodology using deep learning auto-segmentation

delete2023-10-04
delete2
PRE
AI
J
Jingwei Duan
M
Mark E. Bernard
Y
Yi Rong
J
J. Castle
X
Xue Feng
J
Jeremiah D. Johnson
Q
Quan Chen *
DOI:10.1002/mp.16768delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
BackgroundInaccurate manual organ delineation is one of the high-risk failure modes in radiation treatment. Numerous automated contour quality assurance (QA) systems have been developed to assess contour acceptability; however, manual inspection of flagged cases is a time-consuming and challenging process, and can lead to users overlooking the exact error location.PurposeOur aim is to develop and validate a contour QA system that can effectively detect and visualize subregional contour errors, both qualitatively and quantitatively.Methods/MaterialsA novel contour subregion error detection (CSED) system was developed using subregional surface distance discrepancies between manual and deep learning auto-segmentation (DLAS) contours. A validation study was conducted using a head and neck public dataset containing 339 cases and evaluated according to knowledge-based pass criteria derived from a clinical training dataset of 60 cases. A blind qualitative evaluation was conducted, comparing the results from the CSED system with manual labels. Subsequently, the CSED-flagged cases were re-examined by a radiation oncologist.ResultsThe CSED system could visualize the diverse types of subregional contour errors qualitatively and quantitatively. In the validation dataset, the CSED system resulted in true positive rates (TPR) of 0.814, 0.800, and 0.771; false positive rates (FPR) of 0.310, 0.267, and 0.298; and accuracies of 0.735, 0.759, and 0.730, for brainstem and left and right parotid contours, respectively. The CSED-assisted manual review caught 13 brainstem, 19 left parotid, and 21 right parotid contour errors missed by conventional human review. The TPR/FPR/accuracy of the CSED-assisted manual review improved to 0.836/0.253/0.784, 0.831/0.171/0.830, and 0.808/0.193/0.807 for each structure, respectively. Further, the time savings achieved through CSED-assisted review improved by 75%, with the time for review taking 24.81 +/- 12.84, 26.75 +/- 10.41, and 28.71 +/- 13.72 s for each structure, respectively.ConclusionsThe CSED system enables qualitative and quantitative detection, localization, and visualization of manual segmentation subregional errors utilizing DLAS contours as references. The use of this system has been shown to help reduce the risk of high-risk failure modes resulting from inaccurate organ segmentation.
Keywords:
deep learning auto segmentation
OAR delineation
quality assurance

Journal

Medical Physics cover
Medical Physics
IF:
3.2
Papers:
3.7W
Citations:
3.2W

Organization

M
mayo clinic
Scholars:
8.3W
Papers: 6.6W
Citations: 85
M
mayo clinic phoenix
Scholars:
7.1K
Papers: 5.6K
Citations: 4
U
University of Kentucky
Scholars:
2.5W
Papers: 2.1W
Citations: 41
researcher View more organizations
Cited Papers

Cited Papers

Auto-segmentation of organs at risk for head and neck radiotherapy planning: From atlas-based to deep learning methods
err2020-07-28
err107
PREAI
errVrtovec, Tomaz; Mocnik, Domen; Strojan, Primoz; Pernus, Franjo; Ibragimov, Bulat
errShare
errSave
Evaluation of segmentation methods on head and neck CT: Auto-segmentation challenge 2015
err2017-04-21
err219
errOAAI
errRaudaschl, Patrik F.; Zaffino, Paolo; Sharp, Gregory C.; Spadea, Maria Francesca; Chen, Antong; Dawant, Benoit M.; Albrecht, Thomas; Gass, Tobias; Langguth, Christoph; Luthi, Marcel; Jung, Florian; Knapp, Oliver; Wesarg, Stefan; Mannion-Haworth, Richard; Bowes, Mike; Ashman, Annaliese; Guillard, Gwenael; Brett, Alan; Vincent, Graham; Orbes-Arteaga, Mauricio; Cardenas-Pena, David; Castellanos-Dominguez, German; Aghdasi, Nava; Li, Yangming; Berens, Angelique; Moe, Kris; Hannaford, Blake; Schubert, Rainer; Fritscher, Karl D.
errShare
errSave
Contouring quality assurance methodology based on multiple geometric features against deep learning auto-segmentation
err2023-02-25
err16
errOAAI
errDuan, Jingwei; Bernard, Mark E.; Castle, James R.; Feng, Xue; Wang, Chi; Kenamond, Mark C.; Chen, Quan
errShare
errSave
Knowledge-based quality control of organ delineations in radiation therapy
err2022-02-01
err9
PREAI
errNourzadeh, Hamidreza; Hui, Cheukkai; Ahmad, Mahmoud; Sadeghzadehyazdi, Nasrin; Watkins, William T.; Dutta, Sunil W.; Alonso, Clayton E.; Trifiletti, Daniel M.; Siebers, Jeffrey, V
errShare
errSave
A Narrative Review of the Potential Roles of Lipid-Based Vesicles (Vesiculosomes) in Burn Management
err2022-06-29
err0
errOAAI
errBazigha K. Abdul Rasool; Nema Al Mahri; Nora Alburaimi; Fatima Abdallah; Anfal Saeed Bin Shamma
errShare
errSave
Strategies for effective physics plan and chart review in radiation therapy: Report of AAPM Task Group 275
err2020-04-15
err103
errOAAI
errFord, Eric; Conroy, Leigh; Dong, Lei; de los Santos, Luis Fong; Greener, Anne; Kim, Grace Gwe-Ya; Johnson, Jennifer; Johnson, Perry; Mechalakos, James G.; Napolitano, Brian; Parker, Stephanie; Schofield, Deborah; Smith, Koren; Yorke, Ellen; Wells, Michelle
errShare
errSave
Interobserver variability in organ at risk delineation in head and neck cancer
err2021-06-28
err48
errOAAI
errvan der Veen, J.; Gulyban, A.; Willems, S.; Maes, F.; Nuyts, S.
errShare
errSave
Incremental retraining, clinical implementation, and acceptance rate of deep learning auto-segmentation for male pelvis in a multiuser environment
err2023-06-07
err12
PREAI
errDuan, Jingwei; Vargas, Carlos E. E.; Yu, Nathan Y. Y.; Laughlin, Brady S. S.; Toesca, Diego Santos; Keole, Sameer; Rwigema, Jean Claude M.; Wong, William W. W.; Schild, Steven E. E.; Feng, Xue; Chen, Quan; Rong, Yi
errShare
errSave
Automated Quality Assurance of OAR Contouring for Lung Cancer Based on Segmentation With Deep Active Learning
err2020-07-03
err32
errOAAI
errMen, Kuo; Geng, Huaizhi; Biswas, Tithi; Liao, Zhongxing; Xiao, Ying
errShare
errSave
researcher View more