arrow
Return

Complex Network based Supervised Keyword Extractor

delete2020-02-01
delete31
delete
OA
AI
S
Swagata Duari *
DOI:10.1016/j.eswa.2019.112876delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this paper, we present a supervised framework for automatic keyword extraction from single document. We model the text as complex network, and construct the feature set by extracting select node properties from it. Several node properties have been exploited by unsupervised, graph-based keyword extraction methods to discriminate keywords from non-keywords. We exploit the complex interplay of node properties to design a supervised keyword extraction method. The training set is created from the feature set by assigning a label to each candidate keyword depending on whether the candidate is listed as a gold-standard keyword or not. Since the number of keywords in a document is much less than non-keywords, the curated training set is naturally imbalanced. We train a binary classifier to predict keywords after balancing the training set. The model is trained using two public datasets from scientific domain and tested using three unseen scientific corpora and one news corpus. Comparative study of the results with several recent keyword and keyphrase extraction methods establishes that the proposed method performs better in most cases. This substantiates our claim that graph-theoretic properties of words are effective discriminators between keywords and non-keywords. We support our argument by showing that the improved performance of the proposed method is statistically significant for all datasets. We also evaluate the effectiveness of the pre-trained model on Hindi and Assamese language documents. We observe that the model performs equally well for the cross-language text even though it was trained only on English language documents. This shows that the proposed method is independent of the domain, collection, and language of the training corpora. (C) 2019 Elsevier Ltd. All rights reserved.
Keywords:
Supervised keyword extraction
Complex network
Graph-theoretic node properties
Text graph
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

U
university of delhi
Scholars:
1.2W
Papers: 9.7K
Citations: 3
Cited Papers

Cited Papers

The architecture of complex weighted networks
err2004-03-08
err3.2K
errOAAI
errBarrat, A; Barthélemy, M; Pastor-Satorras, R; Vespignani, A
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
Biologically Inspired Soft Robot for Thumb Rehabilitation1
err2014-04-28
err0
PREAI
errPaxton Maeder-York; Tyler Clites; Emily Boggs; Ryan Neff; Panagiotis Polygerinos; Dónal Holland; Leia Stirling; Kevin Galloway; Catherine Wee; Conor Walsh
errShare
errSave
Modified Weighted Mean Filter to Improve the Baseline Reduction Approach for Emotion Recognition
err2022-09-13
err0
errOAAI
errI Made Agus Wirawan; Retantyo Wardoyo; Danang Lelono; Sri Kusrohmaniah
errShare
errSave
errShare
errSave
The influence of age, body mass index, waist-to-hip ratio and anti-Mullerian hormone level on clinical pregnancy rates in ART
err2017-12-21
err0
errOAAI
errAndre Amsiejiene; Grazina Drasutiene; Audrone Usoniene; Janina Tutkuviene; Saule Vilsinskaite; Liucija Barskutyte
errShare
errSave
Local word vectors guiding keyphrase extraction
err2018-11-01
err53
errOAAI
errPapagiannopoulou, Eirini; Tsoumakas, Grigorios
errShare
errSave
researcher View more