arrow
返回

Multi-Layer Multi-Instance Learning for Video Concept Detection

delete2008-12-01
delete13
PRE
AI
Z
Zhiwei Gu *
T
Tao Mei
X
Xian‐Sheng Hua
唐金辉 封面图
唐金辉 (Jinhui Tang)
X
Xiuqing Wu
DOI:10.1109/TMM.2008.2007290delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents a novel learning-based method, called multi-layer multi-instance (MLMI) learning for video concept detection. Most of existing methods have treated video as a flat data sequence and have not investigated the intrinsic hierarchy structure of the video content deeply. However, video is essentially a kind of media with ML structure. For example, a video can be represented by a hierarchical structure including, from large to small, shot, frame, and region, where each pair of contiguous layers fits the typical MI setting. We call such a ML structure and the MI relations embedded in the structure as the MLMI setting. In this paper, we systematically study both ML structure and MI relations embedded in video content by formulating video concept detection as a MLMI learning problem. Specifically, we first construct a MLMI kernel to simultaneously model such ML structure and MI relations. To deal with the ambiguity, propagation problem which is introduced by weak labeling and MI, structure, we then propose a regularization framework which takes hyper-bag prediction error, sublayer prediction error, inter-layer inconsistency measure, and classifier complexity into consideration. We have applied the proposed MLMI learning method to concept detection task over TRECVid 2005 development corpus, and report better performance to vector-based and the state-of-the-art MI learning methods.
Keyword:
Multi-layer multi-instance learning
kernel
video concept detection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Targeting of cohesin by transcriptionally silent chromatin
err2005-11-30
err0
errOAAI
errChuang-Rung Chang; Ching-Shyi Wu; Yolanda Hom; Marc R. Gartenberg
err分享
err收藏
Social Ties at the Neighborhood Level
err1999-09-01
err0
PREAI
errAvery M. Guest; Susan K. Wierzbicki
err分享
err收藏
Under-modified Y base in a tRNAPhe isoacceptor observed in tumor cells
err1979-11-01
err0
PREAI
errYoshiyuki Kuchino; Hiroshi Kasai; Ziro Yamaizumi; Susumu Nishimura; Ernest Borek
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容