arrow
Return

Marginalized multi-layer multi-instance kernel for video concept detection

delete2013-08-01
delete2
PRE
AI
Z
Zheng-Jun Zha *
Tao Mei cover
Tao Mei (Tao Mei)
R
Richang Hong
Z
Zhiwei Gu
DOI:10.1016/j.sigpro.2012.08.026delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Video concept detection has been extensively studied in recent years. Most of the existing video concept detection approaches have treated video as a flat data sequence. However, video is essentially a kind of media with hierarchical structure, including multiple layers (e.g., video shot, frame, and region) and multiple instance relationship embedded in each pair of contiguous layers. In this paper, we propose a novel kernel, termed marginalized multi-layer multi-instance (MarMLMI) kernel for video concept detection. Different from most existing methods, the proposed MarMLMI kernel exploits the hierarchical structure of video, i.e., both the multi-layer structure and the multi-instance relationship. Furthermore, the instance label ambiguity in multi-instance setting is addressed by using the technology of marginalized kernel. We perform video concept detection on a real-world video corpus: the TREC video retrieval evaluation (TRECVID) benchmark and compare the proposed MarMLMI kernel to representative existing approaches. The experimental results demonstrate the effectiveness of the proposed MarMLMI kernel. (C) 2012 Elsevier B.V. All rights reserved.
Keywords:
Multi-layer multi-instance
Marginalized kernel
Video concept detection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Signal Processing cover
Signal Processing
IF:
3.6
Papers:
9.9K
Citations:
1.7W

Organization

M
Microsoft Research Asia
Scholars:
421
Papers: 407
Citations: 2
M
Microsoft
Scholars:
3.0K
Papers: 2.7K
Citations: 7
M
microsoft china
Scholars:
129
Papers: 111
Citations: 0
N
National University of Singapore
Scholars:
7.6W
Papers: 6.5W
Citations: 11.4W
researcher View more organizations
Cited Papers

Cited Papers

Multi-Layer Multi-Instance Learning for Video Concept Detection
err2008-12-01
err13
PREAI
errGu, Zhiwei; Mei, Tao; Hua, Xian-Sheng; Tang, Jinhui; Wu, Xiuqing
errShare
errSave
errShare
errSave
Envelope glycoprotein interactions in coronavirus assembly.
err1995-10-15
err0
errOAAI
errD J Opstelten; M J Raamsman; K Wolfs; M C Horzinek; P J Rottier
errShare
errSave
Visual Query Suggestion: Towards Capturing User Intent in Internet Image Search
err2010-08-27
err84
PREAI
errZha, Zheng-Jun; Yang, Linjun; Mei, Tao; Wang, Meng; Wang, Zengfu; Chua, Tat-Seng; Hua, Xian-Sheng
errShare
errSave
Sequence Multi-Labeling: A Unified Video Annotation Scheme With Spatial and Temporal Context
err2010-12-01
err19
PREAI
errLi, Yuanning; Tian, Yonghong; Duan, Ling-Yu; Yang, Jingjing; Huang, Tiejun; Gao, Wen
errShare
errSave
The Estuarine Component of the Us E.P.A.'S Environmental Monitoring and Assessment Program
err2006-12-05
err0
PREAI
errJohn F. Paul; K. John Scott; A. Fred Holland; Steven B. Weisberg; J. Kevin Summers; Andrew Robertson
errShare
errSave
researcher View more