arrow
Return

Identifying arguments within a text: Categorizing errors and their impact in arguments' relation prediction

delete2024-10-01
delete0
PRE
AI
F
Federico M. Schmidt *
S
Sebastián Gottifredi
A
Alejandro Javier García
DOI:10.1016/j.ijar.2024.109267delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The automatic identification of argument units within a text is a crucial task, as it is the first step that should be performed by an end-to-end argument mining system. In this work, we propose an approach for categorizing errors in predicted argument units, which allows the evaluation of segmentation models from an argumentative perspective. We assess the ability of several models to generalize knowledge across different text domains and, through the proposed categorization, we show differences in their behavior that may not be noticeable using standard classification metrics. Furthermore, we assess how the errors in predicted argument units impact on a task that rely on accurate unit identification, an aspect that has not been studied in previous research, and that helps to evaluate the usability of an imperfect segmentation model beyond the segmentation task itself.
Keywords:
Argumentation mining
Argument unit identification
Error categorization

Journal

International Journal of Approximate Reasoning cover
International Journal of Approximate Reasoning
IF:
3
Papers:
2.9K
Citations:
5.1K

Organization

N
national university of the south
Scholars:
2.3K
Papers: 1.7K
Citations: 2