arrow
返回

Exploiting Semantic and Visual Context for Effective Video Annotation

delete2013-10-01
delete21
PRE
AI
J
Jian Yi *
彭
彭玉鑫 (Yuxin Peng)
J
Jianguo Xiao
DOI:10.1109/TMM.2013.2250266delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a new method to refine the result of video annotation by exploiting the semantic and visual context of video. On one hand, semantic context mining is performed in a supervised way, using the manual concept labels of the training set. It is very useful for boosting video annotation performance, because semantic context is learned from labels given by people, indicating human intention. In this paper, we model the spatial and temporal context in video by using conditional random fields with different structures. Comparing with existing methods, our method could more accurately capture concept relationship in video and could more effectively improve the video annotation performance. On the other hand, visual context mining is performed in a semi-supervised way based on the visual similarities among video shots. It indicates the natural visual property of video, and could be considered as the compensation to semantic context, which generally could not be perfectly modeled. In this paper, we construct a graph based on the visual similarities among shots. Then a semi-supervised learning approach is adopt based on the graph to propagate probabilities of the reliable shots to others having similar visual features with them. Extensive experimental results on the widely used TRECVID datasets exhibit the effectiveness of our method for improving video annotation accuracy.
Keyword:
Context mining
semantic context
video annotation
visual context
video retrieval
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
引用论文

引用论文

DOP60 Environmental risk factors for Inflammatory bowel disease: A large prospective case-control study in India
err2023-01-30
err0
errOAAI
errR Banerjee; P Pal; N Prakash; S Mudigonda; S Joseph; R Patel; M Khalil; A Komawar; S Korikana; D Mekala; Y Akki; A Gaddam; S Valluri
err分享
err收藏
Under-modified Y base in a tRNAPhe isoacceptor observed in tumor cells
err1979-11-01
err0
PREAI
errYoshiyuki Kuchino; Hiroshi Kasai; Ziro Yamaizumi; Susumu Nishimura; Ernest Borek
err分享
err收藏
Toll-like receptor 2 contributes to glial cell activation and heme oxygenase-1 expression in traumatic brain injury
err2008-01-01
err0
PREAI
errChanhee Park; Ik-Hyun Cho; Donghoon Kim; Eun-Kyeong Jo; Se-Young Choi; Seog Bae Oh; Kyoungpyo Park; Joong Soo Kim; Sung Joong Lee
err分享
err收藏
Correlative Multilabel Video Annotation with Temporal Kernels
err2008-10-30
err30
PREAI
errQi, Guo-Jun; Hua, Xian-Sheng; Rui, Yong; Tang, Jinhui; Mei, Tao; Wang, Meng; Zhang, Hong-Jiang
err分享
err收藏
学者 查看更多内容