arrow
Return

Multi-turn dialogue-oriented pretrained question generation model

delete2020-05-16
delete3
delete
OA
AI
Y
Yanmeng Wang
W
Wenge Rong *
J
Jianfei Zhang
S
Shijie Zhou
Z
Zhang Xiong
DOI:10.1007/s40747-020-00147-2delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In recent years, teaching machines to ask meaningful and coherent questions has attracted considerable attention in natural language processing. Question generation has found wide applications in areas such as education (testing knowledge) and chatbots (enhancing interaction). Following previous studies on conversational question generation, we propose a pretrained, encoder-decoder model that can incorporate the semantic information from both passage and hidden conversation representations. We adopt BERT as the encoder to combine external text and dialogue history, and we design a multi-head attention-based decoder to incorporate the semantic information from both text and hidden dialogue representations into the decoding process, thereby generating coherent questions. Experiments with conversational question generation and document-grounded dialogue response generation tasks indicate that the proposed model is superior to baseline models in terms of both standard metrics and human evaluations.
Keywords:
Multi-turn dialogue
Question generation
Pretrained language model
Text passage
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Complex and Intelligent Systems cover
Complex and Intelligent Systems
IF:
4.6
Papers:
2.1K
Citations:
6.6K

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37