.png){kind=icon}
返回
Topic-aware video summarization using multimodal transformer
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.109578.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Video summarization aims to generate a short and compact summary to represent the original video. Existing methods mainly focus on how to extract a general objective synopsis that precisely summaries the video content. However, in real scenarios, a video usually contains rich content with multiple top-ics and people may cast diverse interests on the visual contents even for the same video. In this pa -per, we propose a novel topic-aware video summarization task that generates multiple video summaries with different topics. To support the study of this new task, we first build a video benchmark dataset by collecting videos from various types of movies and annotate them with topic labels and frame-level importance scores. Then we propose a multimodal Transformer model for the topic-aware video summa-rization, which simultaneously predicts topic labels and generates topic-related summaries by adaptively fusing multimodal features extracted from the video. Experimental results show the effectiveness of our method. (c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Topic-aware video summarization
Multimodal transformer
Video summarization dataset
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
Video Summarization Through Reinforcement Learning With a 3D Spatio-Temporal U-Net通过3D时空u-net的强化学习进行视频摘要
OAAI
OAAI分享收藏分享收藏分享收藏
没有更多内容
没有更多内容