arrow
返回

Encoder-Decoder Architectures based Video Summarization using Key-Shot Selection Model

delete2023-09-16
delete4
PRE
AI
K
K. Yashwanth
B
Badal Soni *
DOI:10.1007/s11042-023-16700-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the exponential growth of video data, video summarization has become a challenging task. In this article, we propose a deep learning framework for video summarization that utilizes a sequence learning cum encoder-decoder network architecture with a key-shot selection model. We develop two RNN-based deep models, Additive Attentive Summariser (AAS) and Multiplicative Attentive Summariser (MAS), as well as a CNN-based model named - Sequential CNN Summariser (SCS). Our SCS and MAS model displays state-of-the-art performance in semantic segmentation, which we leverage to achieve superior performance in video summarization. We evaluate our models on two well-known datasets, SumMe and TVSum, and show that our proposed MAS and SCS models outperform state-of-the-art models such as DR-DSN. The proposed MAS model achieved an average F1 score of 44.1% and 60.7% on SumMe and TVSum datasets, respectively. Further, our contributions include the development of novel RNN-based and CNN-based models for video summarization and comprehensive experimental evaluations on multiple datasets that demonstrate the effectiveness of our proposed models.
Keyword:
Deep Learning
CNN
LSTM
RNN
Key-Shot
Summarization

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
1.9W
被引数:
3.2W

机构

N
national institute of technology (nit system)
学者数:
4.0W
论文数: 3.7W
被引数: 31
引用论文

引用论文

DSNet: A Flexible Detect-to-Summarize Network for Video Summarization
err2021-01-01
err103
PREAI
errZhu, Wencheng; Lu, Jiwen; Li, Jiahao; Zhou, Jie
err分享
err收藏
Staff Expectations and Views of Cognitive Behaviour Therapy (CBT) for Adults with Intellectual Disabilities
err2013-05-17
err0
PREAI
errBiza Stenfert Kroese; Andrew Jahoda; Carol Pert; Peter Trower; Dave Dagnan; Mhairi Selkirk
err分享
err收藏
Cloud-Assisted Multiview Video Summarization Using CNN and Bidirectional LSTM基于CNN和双向LSTM的云辅助多视点视频摘要
err2020-01-01
err101
errOAAI
errHussain, Tanveer; Muhammad, Khan; Ullah, Amin; Cao, Zehong; Baik, Sung Wook; de Albuquerque, Victor Hugo C.
err分享
err收藏
Time series forecasting using ensemble learning methods for emergency prevention in hydroelectric power plants with dam
err2022-01-01
err67
PREAI
errStefenon, Stefano Frizzo; Dal Molin Ribeiro, Matheus Henrique; Nied, Ademir; Yow, Kin-Choong; Mariani, Viviana Cocco; Coelho, Leandro dos Santos; Seman, Laio Oriel
err分享
err收藏
学者 查看更多内容