arrow
返回

C3E: A framework for chart classification and content extraction

delete2025-01-01
delete0
PRE
AI
M
Muhammad Suhaib Kanroo
H
Hadia Showkat Kawoosa *
K
Kapil Rana
P
Puneet Goyal
DOI:10.1016/j.compeleceng.2024.109861delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Incorporating charts into technical documents enhances richness by simplifying complex data representation and improving comprehension. However, automated chart content extraction (CCE) presents a significant challenge within the domain of document analysis and understanding. The CCE problem can be viewed through a series of six sub-tasks: chart classification (CC), text detection and recognition (TDR), text role classification (TRC), axis analysis, legend analysis, and data extraction. Improving these sub-tasks is important for enhancing the effectiveness of CCE. This paper introduces the chart classification and content extraction (C3E) framework, with a primary focus on the first three sub-tasks of CCE: CC, TDR, and TRC. We propose a ChartVision model for the CC, an EfficientNet-based model coupled with a dual- branch architecture incorporating a novel hybrid convolutional and dilated attention module. For text detection and TRC, we introduce a novel CCE method based on YOLOv5, CCE-YOLO, designed for localizing and classifying textual components of varying sizes. Further, for text recognition, we employ a convolutional recurrent neural network with connectionist temporal classification loss. We conducted experimental analysis on benchmark datasets to assess the effectiveness of our approach across each sub-task. Specifically, we evaluated CC, TDR, and TRC methods using the UB-PMC 2020 and UB-PMC 2022 datasets from the ICPR2020 and ICPR2022 CHART-Infographics competitions. The C3E framework achieved notable F1-scores of 94.26%, 92.44%, and 80.64% for CC, TDR, and TRC, respectively on the UB-PMC 2020 dataset and 94.0%, 91.98%, and 84.48% for CC, TDR, and TRC, respectively on the UB-PMC 2022 dataset.
Keyword:
Document understanding
Object detection
Chart infographics
Computer vision
BVIP
Chart classification

期刊

C
Computers and Electrical Engineering
IF:
4.9
论文数:
6.7K
被引数:
1.3W

机构

I
indian institute of technology system (iit system)
学者数:
9.5W
论文数: 9.9W
被引数: 93
引用论文

引用论文

Assessment of neurological manifestations in hospitalized patients with COVID‐19Covid-19住院患者神经系统表现的评估
err2020-08-24
err0
errOAAI
errM. Luigetti; R. Iorio; A. R. Bentivoglio; L. Tricoli; V. Riso; J. Marotta; C. Piano; G. Primiano; L. Zileri Del Verme; M. R. Lo Monaco; P. Calabresi
err分享
err收藏
Enhancing Geometric Factors in Model Learning and Inference for Object Detection and Instance Segmentation
err2022-08-01
err620
errOAAI
errZheng, Zhaohui; Wang, Ping; Ren, Dongwei; Liu, Wei; Ye, Rongguang; Hu, Qinghua; Zuo, Wangmeng
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
Performance of purified grape pomace as a fining agent to reduce the levels of some contaminants from wine
err2018-06-05
err0
PREAI
errMaría Dolores Jiménez-Martínez; Rocío Gil-Muñoz; Encarna Gómez-Plaza; Ana Belén Bautista-Ortín
err分享
err收藏
学者 查看更多内容