arrow
Return

ExpliCIT-QA: Explainable Code-Based Image Table Question Answering

delete2026-01-01
delete0
PRE
AI
M
Maximiliano Hormazábal Lagos *
B
Bueno Saez, Alvaro
P
Pedro Alonso Doval
J
Jorge Alcalde Vesteiro
H
Héctor Cerezo‐Costas
DOI:10.1007/978-3-032-05179-0_26delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present ExpliCIT-QA, a system that extends our previous MRT approach for tabular question answering into a multi-modal pipeline capable of handling complex table images and providing explainable answers. ExpliCIT-QA follows a modular design, consisting of: (1) Multimodal Table Understanding, which uses a Chain-ofThought approach to extract and transform content from table images; (2) Language-based Reasoning, where a step-by-step explanation in natural language is generated to solve the problem; (3) Automatic Code Generation, where Python/Pandas scripts are created based on the reasoning steps, with feedback for handling errors; (4) Code Execution to compute the final answer; and (5) Natural Language Explanation that describes how the answer was computed. The system is built for transparency and auditability: all intermediate outputs, parsed tables, reasoning steps, generated code, and final answers are available for inspection. This strategy works towards closing the explainability gap in end-toend TableVQA systems. We evaluated ExpliCIT-QA on the TableVQABench benchmark, comparing it with existing baselines. We demonstrated improvements in interpretability and transparency, which open the door for applications in sensitive domains like finance and healthcare where auditing results are critical. Code available at https://github.com/maxhormazabal/ExpliCIT.
Keywords:
Visual Question Answering
Tabular Data
Explainability
Chain-of-Thought Reasoning

Journal

P
PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2025, PT II
IF:
0
Papers:
36
Citations:
0

Organization

C
centre de visio per computador (cvc)
Scholars:
291
Papers: 246
Citations: 0
A
Autonomous University of Barcelona
Scholars:
3.7W
Papers: 2.6W
Citations: 47
Cited Papers

Cited Papers

Scene Text Visual Question Answering
err2019-10-01
err0
errOAAI
errAli Furkan Biten; Ruben Tito; Andres Mafla; Lluis Gomez; Marcal Rusinol; C.V. Jawahar; Ernest Valveny; Dimosthenis Karatzas
errShare
errSave
Visualizing and Explaining Language Models
err2022-06-05
err0
PREAI
errAdrian M. P. Braşoveanu; Răzvan Andonie
errShare
errSave
TaPas: Weakly Supervised Table Parsing via Pre-training
err2020-01-01
err0
errOAAI
errJonathan Herzig; Pawel Krzysztof Nowak; Thomas Müller; Francesco Piccinno; Julian Eisenschlos
errShare
errSave
LLMs for Financial Advisement: A Fairness and Efficacy Study in Personal Decision Making
err2023-11-25
err0
errOAAI
errKausik Lakkaraju; Sara E Jones; Sai Krishna Revanth Vuruma; Vishal Pallagani; Bharath C Muppasani; Biplav Srivastava
errShare
errSave
errShare
errSave
Multimodal Explanations: Justifying Decisions and Pointing to the Evidence
err2018-06-01
err0
errOAAI
errDong Huk Park; Lisa Anne Hendricks; Zeynep Akata; Anna Rohrbach; Bernt Schiele; Trevor Darrell; Marcus Rohrbach
errShare
errSave
researcher View more