.png){kind=icon}
返回
Radiology Report Annotation Using Generative Large Language Models: Comparative Analysis
.png){kind=icon}
OA
AI
DOI：10.1155/ijbi/5019035.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent advancements in large language models (LLMs), particularly GPT-3.5 and GPT-4, have sparked significant interest in their application within the medical field. This research offers a detailed comparative analysis of the abilities of GPT-3.5 and GPT-4 in the context of annotating radiology reports and generating impressions from chest computed tomography (CT) scans. The primary objective is to use these models to assist healthcare professionals in handling routine documentation tasks. Employing methods such as in-context learning (ICL) and retrieval-augmented generation (RAG), the study focused on generating impression sections from radiological findings. Comprehensive evaluation was applied using a variety of metrics, including recall-oriented understudy for gisting evaluation (ROUGE) for n-gram analysis, Instructor Similarity for contextual similarity, and BERTScore for semantic similarity, to assess the performance of these models. The study shows distinct performance differences between GPT-3.5 and GPT-4 across both zero-shot and few-shot learning scenarios. It was observed that certain prompts significantly influenced the performance outcomes, with specific prompts leading to more accurate impressions. The RAG method achieved a superior BERTScore of 0.92, showcasing its ability to generate semantically rich and contextually accurate impressions. In contrast, GPT-3.5 and GPT-4 excel in preserving language tone, with Instructor Similarity scores of approximately 0.92 across scenarios, underscoring the importance of prompt design in effective summarization tasks. The findings of this research emphasize the critical role of prompt design in optimizing model efficacy and point to the significant potential for further exploration in prompt engineering. Moreover, the study advocates for the standardized integration of such advanced LLMs in healthcare practices, highlighting their potential to enhance the efficiency and accuracy of medical documentation.
Keyword:
GPT-4
in-context learning (ICL)
large language models (LLMs)
medical documentation automation
prompt engineering
radiology report annotation
retrieval-augmented generation (RAG)
期刊
IF:
1.3
论文数:
101
被引数:
728
机构
引用论文
Mutation strategies for obtaining chitooligosaccharides with longer chains by transglycosylation reaction of family GH18 chitinase通过家族GH18几丁质酶的转糖基反应获得长链壳寡糖的突变策略
OAAI
OAAI分享收藏Bile Acid-Induced Arrhythmia Is Mediated by Muscarinic M2 Receptors in Neonatal Rat Cardiomyocytes.png)
PLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏Comparison of the Performance of GPT-3.5 and GPT-4 With That of Medical Students on the Written German Medical Licensing Examination: Observational Study德国书面医学许可考试中GPT-3.5和GPT-4与医学生表现的比较: 观察性研究medical educationOAAI
medical educationIF3.2
OAAI分享收藏分享收藏
查看更多内容