arrow
返回

Movie Description

delete2017-01-25
delete166
delete
OA
AI
A
Anna Rohrbach *
A
Atousa Torabi
M
Marcus Rohrbach
N
Niket Tandon
C
Christopher Pal
H
Hugo Larochelle
A
Aaron Courville
B
Bernt Schiele
DOI:10.1007/s11263-016-0987-1delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Audio description (AD) provides linguistic descriptions of movies and allows visually impaired people to follow a movie along with their peers. Such descriptions are by design mainly visual and thus naturally form an interesting data source for computer vision and computational linguistics. In this work we propose a novel dataset which contains transcribed ADs, which are temporally aligned to full length movies. In addition we also collected and aligned movie scripts used in prior work and compare the two sources of descriptions. We introduce the Large Scale Movie Description Challenge (LSMDC) which contains a parallel corpus of 128,118 sentences aligned to video clips from 200 movies (around 150 h of video in total). The goal of the challenge is to automatically generate descriptions for the movie clips. First we characterize the dataset by benchmarking different approaches for generating video descriptions. Comparing ADs to scripts, we find that ADs are more visual and describe precisely what is shown rather than what should happen according to the scripts created prior to movie production. Furthermore, we present and compare the results of several teams who participated in the challenges organized in the context of two workshops at ICCV 2015 and ECCV 2016.
Keyword:
Movie description
Video description
Video captioning
Video understanding
Movie description dataset
Movie description challenge
Long short-term
memory network
Audio description
LSMDC
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

U
University of California Berkeley
学者数:
3.5W
论文数: 2.8W
被引数: 11.3W
U
universite de montreal
学者数:
4.6W
论文数: 3.8W
被引数: 46
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
P
Polytechnique Montreal
学者数:
3.7K
论文数: 3.4K
被引数: 42
M
Max Planck Society
学者数:
8.2W
论文数: 7.7W
被引数: 3.3W
学者 查看更多机构
引用论文

引用论文

Optimized shaped pupil masks for pupil with obscuration
err2012-08-22
err0
PREAI
errAlexis Carlotti; N. Jeremy Kasdin; Robert J. Vanderbei; Jacques-Robert Delorme
err分享
err收藏
Monetary Policy Effectiveness in China: Evidence from a FAVAR Model
err
IF0
err2014-09-01
err0
errOAAI
errJohn Fernald; Mark Spiegel; Eric Swanson
err分享
err收藏
Phase transitions out of equilibrium: Domain formation and growth
err1993-07-15
err0
errOAAI
errDaniel Boyanovsky; Da-Shin Lee; Anupam Singh
err分享
err收藏
Dense Trajectories and Motion Boundary Descriptors for Action Recognition
err2013-03-06
err1.3K
errOAAI
errWang, Heng; Klaeser, Alexander; Schmid, Cordelia; Liu, Cheng-Lin
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容