.png){kind=icon}
Return
Automatic image and text-based description for colorectal polyps using BASIC classification
.png){kind=icon}
OA
AI
DOI：10.1016/j.artmed.2021.102178.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Colorectal polyps (CRP) are precursor lesions of colorectal cancer (CRC). Correct identification of CRPs during in-vivo colonoscopy is supported by the endoscopist's expertise and medical classification models. A recent developed classification model is the Blue light imaging Adenoma Serrated International Classification (BASIC) which describes the differences between non-neoplastic and neoplastic lesions acquired with blue light imaging (BLI). Computer-aided detection (CADe) and diagnosis (CADx) systems are efficient at visually assisting with medical decisions but fall short at translating decisions into relevant clinical information. The communication between machine and medical expert is of crucial importance to improve diagnosis of CRP during in-vivo procedures. In this work, the combination of a polyp image classification model and a language model is proposed to develop a CADx system that automatically generates text comparable to the human language employed by endoscopists. The developed system generates equivalent sentences as the human-reference and describes CRP images acquired with white light (WL), blue light imaging (BLI) and linked color imaging (LCI). An image feature encoder and a BERT module are employed to build the AI model and an external test set is used to evaluate the results and compute the linguistic metrics. The experimental results show the construction of complete sentences with an established metric scores of BLEU-1 = 0.67, ROUGE-L = 0.83 and METEOR = 0.50. The developed CADx system for automatic CRP image captioning facilitates future advances towards automatic reporting and may help reduce time-consuming histology assessment.
Keywords:
Blue light imaging
Linked color imaging
BASIC
Image captioning
Artificial intelligence
Deep learning
CADx
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6.2
Papers:
2.5K
Citations:
7.8K
Organization
View more organizations
Cited Papers
Accurate Classification of Diminutive Colorectal Polyps Using Computer-Aided Analysis.png)
GASTROENTEROLOGY
GASTROENTEROLOGYIF25.1
PREAI
ShareSaveShareSaveLeaving colorectal polyps in place can be achieved with high accuracy using blue light imaging (BLI)OAAI
OAAIShareSaveUpdate on the Paris classification of superficial neoplastic lesions in the digestive tractENDOSCOPY
ENDOSCOPYIF12.8
PREAI
ShareSave View more