arrow
返回

BREAK It Down: A Question Understanding Benchmark

delete2020-12-01
delete65
delete
OA
AI
T
Tomer Wolfson *
M
Mor Geva
A
Ankit Gupta
M
Matt Gardner
Y
Yoav Goldberg
D
Daniel Deutch
J
Jonathan Berant
DOI:10.1162/tacl_a_00309delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Understanding natural language questions entails the ability to break down a question into the requisite steps for computing its answer. In this work, we introduce a Question Decomposition Meaning Representation (QDMR) for questions. QDMR constitutes the ordered list of steps, expressed through natural language, that are necessary for answering a question. We develop a crowdsourcing pipeline, showing that quality QDMRs can be annotated at scale, and release the BREAK dataset, containing over 83K pairs of questions and their QDMRs. We demonstrate the utility of QDMR by showing that (a) it can be used to improve open-domain question answering on the HOTPOTQA dataset, (b) it can be deterministically converted to a pseudo-SQL formal language, which can alleviate annotation in semantic parsing applications. Last, we use BREAK to train a sequence-to-sequence model with copying that parses questions into QDMR structures, and show that it substantially outperforms several natural baselines.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

T
Transactions of the Association for Computational Linguistics
IF:
6.9
论文数:
486
被引数:
5.7K

机构

B
Bar Ilan University
学者数:
9.7K
论文数: 8.5K
被引数: 59
T
Tel Aviv University
学者数:
3.7W
论文数: 3.0W
被引数: 3.6W
引用论文

引用论文

Aging interacts with tumor biology to produce major changes in the immune tumor microenvironment
err
IF0
err2020-06-08
err0
errOAAI
errRossin Erbe; Zheyu Wang; Neeha Zaidi; Michael Topper; Stephen Baylin; Elizabeth M Jaffee; Hariharan Easwaran; Elana J Fertig
err分享
err收藏
Dry eye and Delayed Tear Clearance: “A Call to Arms”
err2002-01-01
err0
PREAI
errStephen C. Pflugfelder; Abraham Solomon; Dilek Dursun; De-Quan Li
err分享
err收藏
Endothelium-dependent relaxation of human resistance arteries in pregnancy
err1994-11-01
err0
PREAI
errAndrew L. McCarthy; Paul Taylor; John Graves; Shanti K. Raju; Lucilla Poston
err分享
err收藏
Patterns of gestational diabetes diagnosis inside and outside of clinical guidelines
err2017-01-06
err0
errOAAI
errJacinda M. Nicklas; Chloe A. Zera; Janet Lui; Ellen W. Seely
err分享
err收藏
Learning Dependency-Based Compositional Semantics
err2013-06-01
err153
errOAAI
errLiang, Percy; Jordan, Michael I.; Klein, Dan
err分享
err收藏
学者 查看更多内容