arrow
Return

Modeling coherence by ordering paragraphs using pointer networks

delete2020-06-01
delete6
PRE
AI
D
Divesh Pandey
C
C. Ravindranath Chowdary *
DOI:10.1016/j.neunet.2020.02.022delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Coherence is a distinctive feature in well-written documents. One method to study coherence is to analyze how sentences are ordered in a document. In Multi-document Summarization, sentences from different sources need to be ordered. Cluster-based ordering algorithms aim to study various themes or topics that are present in a set of sentences. After the clusters of sentences have been identified, sentences are ordered within each cluster in isolation. One challenge that remains is to order these clusters or paragraphs to obtain a coherent ordering of information. Inspired by the success of deep neural networks in several NLP tasks, we propose an RNN-based encoder-decoder system to predict order for a given set of loose clusters or paragraphs. Universal Sentence Encoder (USE) is used to encode paragraphs into high dimensional embeddings, which are then fed into an LSTM encoder and consecutively passed to a pointer network, which finally outputs the paragraph order. Since Wikipedia is a source of well-structured articles, it is used to generate multiple datasets. Based on our experimental results, the proposed model satisfactorily outperforms the baseline model across multiple datasets. We observe a two-fold increase in Kendall's tau values for the final paragraph orderings. (c) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Ordering paragraphs
Pointer networks
Paragraph embeddings
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93
Cited Papers

Cited Papers

Modeling local coherence: An entity-based approach
err2008-03-01
err316
errOAAI
errBarzilay, Regina; Lapata, Mirella
errShare
errSave
Adaptation of the Photosynthetic Apparatus to Irradiance in Dunaliella tertiolecta
err1990-04-01
err0
errOAAI
errAssaf Sukenik; John Bennett; Anne Mortain-Bertrand; Paul G. Falkowski
errShare
errSave
Joint and segment sequencing and its relationship to ball velocity and throwing arm kinetics in professional pitchers
err2022-05-01
err0
PREAI
errJoseph E. Manzi; Brittany Dowling; Zhaorui Wang; Jim R. Lamb; Emily G. Fry; Kathryn D. McElheny; Michael C. Fu; Joshua S. Dines
errShare
errSave
Gender Disparity Among Leaders of Canadian Academic Radiology Departments
err2020-01-01
err0
PREAI
errSadia Raheez Qamar; Kiran Khurshid; Sabeena Jalal; Matthew D. F. McInnes; Linda Probyn; Karen Finlay; Cameron J. Hague; Rebecca M. Hibbert; Manish Joshi; Frank J. Rybicki; Alison Harris; Savvas Nicolaou; Faisal Khosa
errShare
errSave
Centroid-based summarization of multiple documents
err2004-11-01
err625
PREAI
errRadev, DR; Jing, HY; Stys, M; Tam, D
errShare
errSave
no more