返回
Automatic image and text-based description for colorectal polyps using BASIC classification
DOI:10.1016/j.artmed.2021.102178.png)
摘要
En 中文
Colorectal polyps (CRP) are precursor lesions of colorectal cancer (CRC). Correct identification of CRPs during in-vivo colonoscopy is supported by the endoscopist's expertise and medical classification models. A recent developed classification model is the Blue light imaging Adenoma Serrated International Classification (BASIC) which describes the differences between non-neoplastic and neoplastic lesions acquired with blue light imaging (BLI). Computer-aided detection (CADe) and diagnosis (CADx) systems are efficient at visually assisting with medical decisions but fall short at translating decisions into relevant clinical information. The communication between machine and medical expert is of crucial importance to improve diagnosis of CRP during in-vivo procedures. In this work, the combination of a polyp image classification model and a language model is proposed to develop a CADx system that automatically generates text comparable to the human language employed by endoscopists. The developed system generates equivalent sentences as the human-reference and describes CRP images acquired with white light (WL), blue light imaging (BLI) and linked color imaging (LCI). An image feature encoder and a BERT module are employed to build the AI model and an external test set is used to evaluate the results and compute the linguistic metrics. The experimental results show the construction of complete sentences with an established metric scores of BLEU-1 = 0.67, ROUGE-L = 0.83 and METEOR = 0.50. The developed CADx system for automatic CRP image captioning facilitates future advances towards automatic reporting and may help reduce time-consuming histology assessment.
Keyword:
Blue light imaging
Linked color imaging
BASIC
Image captioning
Artificial intelligence
Deep learning
CADx
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.2
论文数:
2.5K
被引数:
7.8K
机构
引用论文
Accurate Classification of Diminutive Colorectal Polyps Using Computer-Aided Analysis
GASTROENTEROLOGY
IF25.1
Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy通过使用实时图像识别系统和窄带成像放大结肠镜对结直肠息肉组织学进行计算机辅助诊断
Leaving colorectal polyps in place can be achieved with high accuracy using blue light imaging (BLI)
Update on the Paris classification of superficial neoplastic lesions in the digestive tract
ENDOSCOPY
IF12.8

