arrow
返回

Automatic Text Summarization Method Based on Improved TextRank Algorithm and K-Means Clustering

delete2024-03-01
delete4
PRE
AI
W
Wenjun Liu *
Y
Yuyan Sun
Y
Yu Bao
H
Hailan Wang
M
Mengshu Hou *
H
Huan Guo
H
Hai Wang
C
Cheng Liu
DOI:10.1016/j.knosys.2024.111447delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Automatic text summarization is to obtain a summary by compressing the text while retaining its important information. Then users can obtain the important content of the text by reading the summary. In the research literatures, the extraction summary method is widely used and is also one type of the main research methods of summary methods. However, this extraction summary method still has some problems. The selection of the initial cluster center has not been carefully determined, and the sentence redundancy summarized is high in articles with complex sentences. In order to solve the above problems, this paper proposes an automatic text summarization method based on improved TextRank algorithm and K -Means clustering. This method combines the improved BM25 model and the TextRank algorithm to calculate the BM25 similarity between sentences and obtain the TR scores of sentences. The TR scores are used to select the initial center of clustering based on similarity difference judgment and maximum judgment. The final summary is obtained by combining the cluster scores and sentence scores. The experimental results show that the proposed method in this paper has better evaluation indicators containing ROUGE -1, ROUGE -2 and ROUGE -L than other comparison algorithms including Lead -3, TextRank and MBM25EMB on the DUC2004 dataset. In conclusion, the proposed method in this paper improves the accuracy of automatic text summarization and reduce the redundancy from documents.
Keyword:
Text Summarization
Sentence Vector
K -means Clustering
Word Embedding
TextRank Algorithm

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

X
Xihua University
学者数:
6.2K
论文数: 3.6K
被引数: 4.1K
引用论文

引用论文

Altered Gravity Highlights Central Pattern Generator Mechanisms
err2008-11-01
err0
PREAI
errOlivier White; Yannick Bleyenheuft; Renaud Ronsse; Allan M. Smith; Jean-Louis Thonnard; Philippe Lefèvre
err分享
err收藏
err分享
err收藏
COSUM: Text summarization based on clustering and optimization
err2018-10-12
err69
errOAAI
errAlguliyev, Rasim M.; Aliguliyev, Ramiz M.; Isazade, Nijat R.; Abdi, Asad; Idris, Norisma
err分享
err收藏
err分享
err收藏
学者 查看更多内容