arrow
返回

Predicting Important Objects for Egocentric Video Summarization

delete2015-01-07
delete105
PRE
AI
L
Lee, Yong Jae *
G
Grauman, Kristen
DOI:10.1007/s11263-014-0794-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present a video summarization approach for egocentric or wearable camera data. Given hours of video, the proposed method produces a compact storyboard summary of the camera wearer's day. In contrast to traditional keyframe selection techniques, the resulting summary focuses on the most important objects and people with which the camera wearer interacts. To accomplish this, we develop region cues indicative of high-level saliency in egocentric video-such as the nearness to hands, gaze, and frequency of occurrence-and learn a regressor to predict the relative importance of any new region based on these cues. Using these predictions and a simple form of temporal event detection, our method selects frames for the storyboard that reflect the key object-driven happenings. We adjust the compactness of the final summary given either an importance selection criterion or a length budget; for the latter, we design an efficient dynamic programming solution that accounts for importance, visual uniqueness, and temporal displacement. Critically, the approach is neither camera-wearer-specific nor object-specific; that means the learned importance metric need not be trained for a given user or context, and it can predict the importance of objects and people that have never been seen previously. Our results on two egocentric video datasets show the method's promise relative to existing techniques for saliency and summarization.
Keyword:
Egocentric vision
Video summarization
Category discovery
Saliency detection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

U
university of california davis
学者数:
3.4W
论文数: 2.6W
被引数: 45
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
引用论文

引用论文

Large mesoporous micro-spheres of WO3/TiO2 composite with enhanced visible light photo activity
err2013-01-01
err0
PREAI
errSajjad Ahmed Khan Leghari; Shamaila Sajjad; Jinlong Zhang
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Late diagenesis of illite-smectite in the Podhale Basin, southern Poland: Chemistry, morphology, and preferred orientation
err2017-10-05
err0
errOAAI
errRuarri J. Day-Stirrat; Andrew C. Aplin; Kuncho D. Kurtev; Anja M. Schleicher; Andrew P. Brown; Jan Środoń
err分享
err收藏
err分享
err收藏
学者 查看更多内容