arrow
Return

Dynamic Mode Decomposition Based Video Shot Detection

delete2018-01-01
delete49
delete
OA
AI
C
Chongke Bi
Y
Ye Yuan
J
Jiawan Zhang *
Y
Yun Shi
Y
Yiqing Xiang
王岳环 (Yuehuan Wang)
R
Ronghui Zhang
DOI:10.1109/ACCESS.2018.2825106delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Shot detection is widely used in video semantic analysis, video scene segmentation, and video retrieval. However, this is still a challenging task, due to the weak boundary and a sudden change in brightness or foreground objects. In this paper, we propose a new framework based on dynamic mode decomposition (DMD) for shot boundary detection. Because the DMD can extract several temporal foreground modes and one temporal background mode from video data, shot boundaries can be detected when the amplitude changes sharply. Here, the amplitude is the DMD coefficient to restore the video. The main idea behind the shot boundaries detection is finding the amplitude change of background mode. We can reduce error detection when the illumination changes sharply or the foreground object (or camera) moves very quickly. At the same time, our algorithm has a high detection accuracy, even the color changes are not obvious, the illumination changes slowly, or the foreground objects overlap. Meanwhile, a color space for DMD is selected for reducing false detection. Finally, the effectiveness of our method will be demonstrated through detecting the shot boundaries of the various content types of videos.
Keywords:
Dynamic mode decomposition
video shot detection
shot boundary
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.7W
Citations: 88
C
chinese academy of agricultural sciences
Scholars:
5.0W
Papers: 3.0W
Citations: 43
researcher View more organizations