arrow
返回

Interpretable semantic textual similarity: Finding and explaining differences between sentences

delete2017-03-01
delete29
delete
OA
AI
I
Iñigo López-Gazpio
M
Montse Maritxalar
A
Aitor González-Agirre
G
Germán Rigau
L
Larraitz Uria
E
Eneko Agirre *
DOI:10.1016/j.knosys.2016.12.013delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
User acceptance of artificial intelligence agents might depend on their ability to explain their reasoning to the users. We focus on a specific text processing task, the Semantic Textual Similarity task (STS), where systems need to measure the degree of semantic equivalence between two sentences. We propose to add an interpretability layer (iSTS for short) formalized as the alignment between pairs of segments across the two sentences, where the relation between the segments is labeled with a relation type and a similarity score. This way, a system performing STS could use the interpretability layer to explain to users why it returned that specific score for the given sentence pair. We present a publicly available dataset of sentence pairs annotated following the formalization. We then develop an iSTS system trained on this dataset, which given a sentence pair finds what is similar and what is different, in the form of graded and typed segment alignments. When evaluated on the dataset, the system performs better than an informed baseline, showing that the dataset and task are well-defined and feasible. Most importantly, two user studies show how the iSTS system output can be used to automatically produce explanations in natural language. Users performed the two tasks better when having access to the explanations, providing preliminary evidence that our dataset and method to automatically produce explanations do help users ;understand the output of STS systems better. (C) 2016 Elsevier B.V. All rights reserved.
Keyword:
Interpretability
Tutoring systems
Semantic textual similarity
Natural language understanding
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.2W
被引数:
4.5W

机构

U
university of basque country
学者数:
1.9W
论文数: 1.6W
被引数: 17
引用论文

引用论文

Methods for cross-language plagiarism detection
err2013-09-01
err52
errOAAI
errBarron-Cedeno, Alberto; Gupta, Parth; Rosso, Paolo
err分享
err收藏
err分享
err收藏
Electrocortical activity in the near-term ovine fetus: Automated analysis using amplitude frequency components
err2011-07-01
err0
PREAI
errAshley E. Keen; Martin G. Frasch; Melissa A. Sheehan; Brad J. Matushewski; Bryan S. Richardson
err分享
err收藏
IS THE HUMAN STRETCH REFLEX CORTICAL RATHER THAN SPINAL ?
err1973-04-01
err0
PREAI
errC.D. Marsden; P.A. Merton; H.B. Morton
err分享
err收藏
Anhydrous Proton-Conducting Polymeric Electrolytes for Fuel Cells
err2006-02-03
err0
PREAI
errS. R. Narayanan; Shiao-Pin Yen; L. Liu; S. G. Greenbaum
err分享
err收藏
Iron isotope differences between Earth, Moon, Mars and Vesta as possible records of contrasted accretion mechanisms
err2004-07-01
err0
PREAI
errFranck Poitrasson; Alexander N. Halliday; Der-Chuen Lee; Sylvain Levasseur; Nadya Teutsch
err分享
err收藏
Perinatal Maternal and Neonatal Outcomes in Women With Gestational Diabetes Mellitus According to Fetal Sex
err2012-12-01
err0
PREAI
errDiana Tundidor; Apolonia García-Patterson; Miguel A. María; Justa Ubeda; Gemma Ginovart; Juan M. Adelantado; Alberto de Leiva; Rosa Corcoy
err分享
err收藏
Screening for Inclusion Compounds and Systematic Construction of Three‐Component Solids by Liquid‐Assisted Grinding
err2006-11-14
err0
PREAI
errTomislav Friščić; Andrew V. Trask; William Jones; W. D. Samuel Motherwell
err分享
err收藏
err分享
err收藏
学者 查看更多内容