arrow
返回

Enhancing Video Event Recognition Using Automatically Constructed Semantic-Visual Knowledge Base

delete2015-09-01
delete29
PRE
AI
X
Xishan Zhang *
杨
杨阳 (Yang Yang)
张
张勇东 (Yongdong Zhang)
H
Huanbo Luan
李
李锦涛 (Jintao Li)
H
Hanwang Zhang
T
Tat‐Seng Chua
DOI:10.1109/TMM.2015.2449660delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The task of recognizing events from video has attracted a lot of attention in recent years. However, due to the complex nature of user-defined events, the use of purely audio-visual content analysis without domain knowledge has been found to be grossly inadequate. In this paper, we propose to construct a semantic-visual knowledge base to encode the rich event-centric concepts and their relationships from the well-established lexical databases, including FrameNet, as well as the concept-specific visual knowledge from ImageNet. Based on this semantic-visual knowledge bases, we design an effective system for video event recognition. Specifically, in order to narrow the semantic gap between the high-level complex events and low-level visual representations, we utilize the event-centric semantic concepts encoded in the knowledge base as the intermediate-level event representation, which offers both human-perceivable and machine-interpretable semantic clues for event recognition. In addition, in order to leverage the abundant ImageNet images, we propose a robust transfer learning model to learn the noise-resistant concept classifiers for videos. Extensive experiments on various real-world video datasets demonstrate the superiority of our proposed system as compared to the state-of-the-art approaches.
Keyword:
Concept detection
event recognition
knowledge base
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err2002-01-01
err0
PREAI
errPratibha L. Gai
err分享
err收藏
DOP14 Validation of a new OPtical diagnosis Training platform to Improve dysplasia Characterisation in Inflammatory Bowel Disease (OPTIC-IBD): A multicentre randomised controlled study
err2022-01-21
err0
errOAAI
errM Iacucci; R J M Ingram; A Bazarova; R Cannatelli; N Labarile; O M Nardone; T L Parigi; K Siau; S C L Smith; J G P Ferraz; R Kiesslich; R Panaccione; A Parra-Blanco; G E Tontini; T Uraoka; S Ghosh
err分享
err收藏
err分享
err收藏
Deposition Of Aluminium Nitride Film By Ion Beam Enhanced Reactive Magnetron Sputtering
err2011-02-16
err0
PREAI
errR. F. Huang; L. S. Wen; H. Wang; J. Wu; R. J. Hong
err分享
err收藏
DrosophilaNeurexin IV Interacts with Roundabout and Is Required for Repulsive Midline Axon Guidance
err2010-04-21
err0
errOAAI
errSwati Banerjee; Kevin Blauth; Kimberly Peters; Stephen L. Rogers; Alan S. Fanning; Manzoor A. Bhat
err分享
err收藏
err分享
err收藏
学者 查看更多内容