arrow
返回

Automatic image and text-based description for colorectal polyps using BASIC classification

delete2021-11-01
delete9
delete
OA
AI
R
Roger Fonollà *
Q
Quirine E. W. van der Zander
R
R. M. Schreuder
S
Sharmila Subramaniam
P
Pradeep Bhandari
A
Ad Masclee
E
Erik J. Schoon
F
Fons van der Sommen
P
Peter H. N. de With
DOI:10.1016/j.artmed.2021.102178delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Colorectal polyps (CRP) are precursor lesions of colorectal cancer (CRC). Correct identification of CRPs during in-vivo colonoscopy is supported by the endoscopist's expertise and medical classification models. A recent developed classification model is the Blue light imaging Adenoma Serrated International Classification (BASIC) which describes the differences between non-neoplastic and neoplastic lesions acquired with blue light imaging (BLI). Computer-aided detection (CADe) and diagnosis (CADx) systems are efficient at visually assisting with medical decisions but fall short at translating decisions into relevant clinical information. The communication between machine and medical expert is of crucial importance to improve diagnosis of CRP during in-vivo procedures. In this work, the combination of a polyp image classification model and a language model is proposed to develop a CADx system that automatically generates text comparable to the human language employed by endoscopists. The developed system generates equivalent sentences as the human-reference and describes CRP images acquired with white light (WL), blue light imaging (BLI) and linked color imaging (LCI). An image feature encoder and a BERT module are employed to build the AI model and an external test set is used to evaluate the results and compute the linguistic metrics. The experimental results show the construction of complete sentences with an established metric scores of BLEU-1 = 0.67, ROUGE-L = 0.83 and METEOR = 0.50. The developed CADx system for automatic CRP image captioning facilitates future advances towards automatic reporting and may help reduce time-consuming histology assessment.
Keyword:
Blue light imaging
Linked color imaging
BASIC
Image captioning
Artificial intelligence
Deep learning
CADx
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Artificial Intelligence in Medicine 封面图
Artificial Intelligence in Medicine
IF:
6.2
论文数:
2.5K
被引数:
7.8K

机构

M
Maastricht University
学者数:
3.1W
论文数: 2.8W
被引数: 277
C
Catharina Hospital
学者数:
2.8K
论文数: 2.5K
被引数: 34
E
Eindhoven University of Technology
学者数:
1.6W
论文数: 1.5W
被引数: 2.2W
学者 查看更多机构
引用论文

引用论文

Role of inflammatory response in liver diseases: Therapeutic strategies
err2018-01-27
err0
errOAAI
errJosé A Del Campo; Paloma Gallego; Lourdes Grande
err分享
err收藏
Use of Eye Movement Auditory Biofeedback in the Control of Nystagmus
err1982-05-01
err0
PREAI
errKENNETH J. CIUFFREDA; STANLEY G. GOLDRICH; CATHERINE NEARY
err分享
err收藏
Accurate Classification of Diminutive Colorectal Polyps Using Computer-Aided Analysis
err2018-02-01
err301
PREAI
errChen, Peng-Jen; Lin, Meng-Chiung; Lai, Mei-Ju; Lin, Jung-Chun; Lu, Henry Horng-Shing; Tseng, Vincent S.
err分享
err收藏
NOTES
errBMJ
IF0
err1992-02-29
err0
PREAI
err
err分享
err收藏
Biorthogonal Wavelet Expansions
err1997-07-01
err0
PREAI
errW. Dahmen; C. A. Micchelli
err分享
err收藏
err分享
err收藏
Leaving colorectal polyps in place can be achieved with high accuracy using blue light imaging (BLI)
err2018-08-01
err21
errOAAI
errNeumann, Helmut; Sen, Helmut Neumann; Vieth, Michael; Bisschops, Raf; Thieringer, Florian; Rahman, Khan F.; Gamstaetter, Thomas; Tontini, Gian Eugenio; Galle, Peter R.
err分享
err收藏
Update on the Paris classification of superficial neoplastic lesions in the digestive tract
errENDOSCOPY
IF12.8
err2005-06-01
err717
PREAI
errAxon, A; Diebold, MD; Fujino, M; Fujita, R; Genta, RM; Gonvers, JJ; Guelrud, M; Inoue, H; Jung, M; Kashida, H; Kudo, S; Lambert, R; Lightdale, C; Nakamura, T; Neuhaus, H; Niwa, H; Ogoshi, K; Rey, JF; Riddell, R; Sasako, M; Shimoda, T; Suzuki, H; Tytgat, GNJ; Wang, K; Watanabe, H; Yamakawa, T; Yoshida, S
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容