arrow
Return

Multi-View Video Summarization

delete2010-11-01
delete144
PRE
AI
Y
Yanwei Fu *
Y
Yanwen Guo
F
Feng Liu
宋
宋传鸣 (Chuanming Song)
Zhi-Hua Zhou cover
Zhi-Hua Zhou (Zhi‐Hua Zhou)
DOI:10.1109/TMM.2010.2052025delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Previous video summarization studies focused on monocular videos, and the results would not be good if they were applied to multi-view videos directly, due to problems such as the redundancy in multiple views. In this paper, we present a method for summarizing multi-view videos. We construct a spatio-temporal shot graph and formulate the summarization problem as a graph labeling task. The spatio-temporal shot graph is derived from a hypergraph, which encodes the correlations with different attributes among multi-view video shots in hyperedges. We then partition the shot graph and identify clusters of event-centered shots with similar contents via random walks. The summarization result is generated through solving a multi-objective optimization problem based on shot importance evaluated using a Gaussian entropy fusion scheme. Different summarization objectives, such as minimum summary length and maximum information coverage, can be accomplished in the framework. Moreover, multi-level summarization can be achieved easily by configuring the optimization parameters. We also propose the multi-view storyboard and event board for presenting multi-view summaries. The storyboard naturally reflects correlations among multi-view summarized shots that describe the same important event. The event-board serially assembles event-centered multi-view shots in temporal order. Single video summary which facilitates quick browsing of the summarized multi-view video can be easily generated based on the event board representation.
Keywords:
Multi-objective optimization
multi-view video
random walks
spatio-temporal graph
video summarization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

University of Wisconsin System cover
University of Wisconsin System
Scholars:
6.7W
Papers: 5.8W
Citations: 382
N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
Cited Papers

Cited Papers

Fuzzy sets
err1965-06-01
err0
errOAAI
errL.A. Zadeh
errShare
errSave
Primary blood neutrophils express a functional cell surface Toll‐like receptor 9
err2013-08-09
err0
errOAAI
errDennis Lindau; Julie Mussard; Britta J. Wagner; Matthieu Ribon; Viktoria M. Rönnefarth; Maude Quettier; Ivan Jelcic; Marie‐Christophe Boissier; Hans‐Georg Rammensee; Patrice Decker
errShare
errSave
Study of the room temperature molecular memory observed from a nanowell device
err2005-07-01
err0
PREAI
errN. Gergel; N. Majumdar; K. Keyvanfar; N. Swami; L. R. Harriott; J. C. Bean; Gyana Pattanaik; Giovanni Zangari; Y. Yao; J. M. Tour
errShare
errSave
Phosphate Phosphors for Solid-State Lighting
err2012-01-01
err0
errOAAI
errKartik N. Shinde; S.J. Dhoble; H.C. Swart; Kyeongsoon Park
errShare
errSave
err2002-01-01
err0
PREAI
errPeter C. Austin; Deanna M. Rothwell; Jack V. Tu
errShare
errSave
Video collage: presenting a video sequence using a single image
err2008-08-19
err60
PREAI
errMei, Tao; Yang, Bo; Yang, Shi-Qiang; Hua, Xian-Sheng
errShare
errSave
A Review of Corneal Blindness: Causes and Management
err2022-10-09
err0
errOAAI
errShivangi C Tidke; Pravin Tidake
errShare
errSave
High-quality video view interpolation using a layered representation
err2004-08-01
err1.0K
PREAI
errZitnick, CL; Kang, SB; Uyttendaele, M; Winder, S; Szeliski, R
errShare
errSave
researcher View more