arrow
Return

Quick-MIMIC: A Multimodal Data Extraction Pipeline for MIMIC with Parallelization

delete2024-12-01
delete0
delete
OA
AI
Y
Yutao Dou
李微 (Wei Li)
X
Xiaojun Yao
H
Huanxiang Liu
A
Albert Y. Zomaya
彭绍亮 cover
彭绍亮 (Shaoliang Peng) *
DOI:10.26599/BDMA.2024.9020024delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Medical big data with artificial intelligence are vital in advancing digital medicine. However, the opaque and non-standardised nature embedded in most medical data extraction is prone to batch effects and has become a significant obstacle to reproducing previous works. This paper aims to develop an easy-to-use time-series multimodal data extraction pipeline, Quick-MIMIC, for standardised data extraction from MIMIC datasets. Our method can fully integrate different data structures into a time-series table, including structured, semi-structured, and unstructured data. We also introduce two additional modules to Quick-MIMIC, a pipeline parallelization method and data analysis methods, for reducing the data extraction time and presenting the characteristics of the extracted data intuitively. The extensive experimental results show that our pipeline can efficiently extract the needed data from the MIMIC dataset and convert it into the correct format for further analytic tasks.
Keywords:
MIMIC dataset
data extraction pipeline
data integration
data integration
data extraction pipeline
data integration

Journal

Big Data Mining and Analytics cover
Big Data Mining and Analytics
IF:
6.2
Papers:
274
Citations:
1.0K

Organization

No organization information available