返回
Predicting Important Objects for Egocentric Video Summarization
DOI:10.1007/s11263-014-0794-5.png)
摘要
En 中文
We present a video summarization approach for egocentric or wearable camera data. Given hours of video, the proposed method produces a compact storyboard summary of the camera wearer's day. In contrast to traditional keyframe selection techniques, the resulting summary focuses on the most important objects and people with which the camera wearer interacts. To accomplish this, we develop region cues indicative of high-level saliency in egocentric video-such as the nearness to hands, gaze, and frequency of occurrence-and learn a regressor to predict the relative importance of any new region based on these cues. Using these predictions and a simple form of temporal event detection, our method selects frames for the storyboard that reflect the key object-driven happenings. We adjust the compactness of the final summary given either an importance selection criterion or a length budget; for the latter, we design an efficient dynamic programming solution that accounts for importance, visual uniqueness, and temporal displacement. Critically, the approach is neither camera-wearer-specific nor object-specific; that means the learned importance metric need not be trained for a given user or context, and it can predict the importance of objects and people that have never been seen previously. Our results on two egocentric video datasets show the method's promise relative to existing techniques for saliency and summarization.
Keyword:
Egocentric vision
Video summarization
Category discovery
Saliency detection
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
Large mesoporous micro-spheres of WO3/TiO2 composite with enhanced visible light photo activity
RSC Advances
IF0
Late diagenesis of illite-smectite in the Podhale Basin, southern Poland: Chemistry, morphology, and preferred orientation
Geosphere
IF0

