.png){kind=icon}
返回
Improving tabular data extraction in scanned laboratory reports using deep learning models
.png){kind=icon}
PRE
AI
DOI：10.1016/j.jbi.2024.104735.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Objective: Medical laboratory testing is essential in healthcare, providing crucial data for diagnosis and treatment. Nevertheless, patients' lab testing results are often transferred via fax across healthcare organizations and are not immediately available for timely clinical decision making. Thus, it is important to develop new technologies to accurately extract lab testing information from scanned laboratory reports. This study aims to develop an advanced deep learning-based Optical Character Recognition (OCR) method to identify tables containing lab testing results in scanned laboratory reports. Methods: Extracting tabular data from scanned lab reports involves two stages: table detection (i.e., identifying the area of a table object) and table recognition (i.e., identifying and extracting tabular structures and contents). DETR R18 algorithm as well as YOLOv8s were involved for table detection, and we compared the performance of PaddleOCR and the encoder-dual-decoder (EDD) model for table recognition. 650 tables from 632 randomly selected laboratory test reports were annotated and used to train and evaluate those models. For table detection evaluation, we used metrics such as Average Precision (AP), Average Recall (AR), AP50, and AP75. For table recognition evaluation, we employed Tree-Edit Distance (TEDS). Results: For table detection, fine-tuned DETR R18 demonstrated superior performance (AP50: 0.774; AP75: 0.644; AP: 0.601; AR: 0.766). In terms of table recognition, fine-tuned EDD outperformed other models with a TEDS score of 0.815. The proposed OCR pipeline (fine-tuned DETR R18 and fine-tuned EDD), demonstrated impressive results, achieving a TEDS score of 0.699 and a TEDS structure score of 0.764. Conclusions: Our study presents a dedicated OCR pipeline for scanned clinical documents, utilizing state-of-theart deep learning models for region-of-interest detection and table recognition. The high TEDS scores demonstrate the effectiveness of our approach, which has significant implications for clinical data analysis and decisionmaking.
Keyword:
Optical Character Recognition
Natural Language Processing
Electronic Health Records
Artificial Intelligence
Deep learning
Information Extraction
期刊
IF:
4.5
论文数:
3.5K
被引数:
1.9W
机构
引用论文
Artificial intelligence-powered pharmacovigilance: A review of machine and deep learning in clinical text-based adverse drug event detection for benchmark datasets人工智能驱动的药物警戒: 基准数据集的基于临床文本的药物不良事件检测中的机器和深度学习综述
PREAI
分享收藏分享收藏The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: a systematic review.png)
IMPLEMENTATION SCIENCE
OAAI
IMPLEMENTATION SCIENCEIF13.4
OAAI分享收藏
查看更多内容