arrow
返回

Semantic Reasoning in Zero Example Video Event Retrieval

delete2017-10-04
delete14
delete
OA
AI
D
de Boer, Maaike H. T. *
Y
Yijie Lu
H
Hao Zhang
K
Klamer Schutte
C
Chong‐Wah Ngo
W
Wessel Kraaij
DOI:10.1145/3131288delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Searching in digital video data for high-level events, such as a parade or a car accident, is challenging when the query is textual and lacks visual example images or videos. Current research in deep neural networks is highly beneficial for the retrieval of high-level events using visual examples, but without examples it is still hard to (1) determine which concepts are useful to pre-train (Vocabulary challenge) and (2) which pre-trained concept detectors are relevant for a certain unseen high-level event (Concept Selection challenge). In our article, we present our Semantic Event Retrieval Systemwhich (1) shows the importance of high-level concepts in a vocabulary for the retrieval of complex and generic high-level events and (2) uses a novel concept selection method (i-w2v) based on semantic embeddings. Our experiments on the international TRECVID Multimedia Event Detection benchmark show that a diverse vocabulary including high-level concepts improves performance on the retrieval of high-level events in videos and that our novel method outperforms a knowledge-based concept selection method.
Keyword:
Content-based visual information retrieval
multimedia event detection
zero shot
semantics
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

N
Netherlands Organization Applied Science Research
学者数:
4.5K
论文数: 3.4K
被引数: 3
C
City University of Hong Kong
学者数:
2.3W
论文数: 3.0W
被引数: 6.1W
引用论文

引用论文

err分享
err收藏
A Numerical Round Robin for the Prediction of the Dynamics of Jointed Structures
err2016-05-12
err0
errOAAI
errJ. Gross; J. Armand; R. M. Lacayo; P. Reuss; L. Salles; C. W. Schwingshackl; M. R. W. Brake; R. J. Kuether
err分享
err收藏
Deposition Of Aluminium Nitride Film By Ion Beam Enhanced Reactive Magnetron Sputtering
err2011-02-16
err0
PREAI
errR. F. Huang; L. S. Wen; H. Wang; J. Wu; R. J. Hong
err分享
err收藏
Anatase-to-rutile transition in co-doped TiO2 pigments
err2017-04-17
err0
PREAI
errTania Regina Giraldi; Jeferson Almeida Dias; Carly Mirela Baggio; Sylma Carvalho Maestrelli; Jéssica Ariane Oliveira
err分享
err收藏
Theoretical Study of AlnNn, GanNn, and InnNn(n= 4, 5, 6) Clusters
err2002-01-30
err0
PREAI
errAnil K. Kandalam; Miguel A. Blanco; Ravindra Pandey
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
学者 查看更多内容