Multi-layer multi-view topic model for classifying advertising video

doi:10.1016/j.patcog.2017.03.003

Return

Multi-layer multi-view topic model for classifying advertising video

2017-08-01

PRE

郑元杰 (Yuanjie Zheng) *

DOI：10.1016/j.patcog.2017.03.003

Original

Original request for help

Save

Abstract

En 中文

The recent proliferation of advertising (ad) videos has driven the research in multiple applications, ranging from video analysis to video indexing and retrieval. Among them, classifying ad video is a key task because it allows automatic organization of videos according to categories or genres, and this further enables ad video indexing and retrieval. However, classifying ad video is challenging compared to other types of video classification because of its unconstrained content. While many studies focus on embedding ads relevant to videos, to our knowledge, few focus on ad video classification. In order to classify ad video, this paper proposes a novel ad video representation that aims to sufficiently capture the latent semantics of video content from multiple views in an unsupervised manner. In particular, we represent ad videos from four views, including bag-of-feature (BOF), vector of locally aggregated descriptors (VLAD), fisher vector (FV) and object bank (OB). We then devise a multi-layer multi-view topic model, mlmv_LDA, which models the topics of videos from different views. A topical representation for video, supporting category-related task, is finally achieved by the proposed method. Our empirical classification results on 10,111 real-world ad videos demonstrate that the proposed approach effectively differentiate ad videos. (C) 2017 Elsevier Ltd. All rights reserved.

Keywords:

Video representation

Ad video classification

Multi-layer

Multi-view

Topic model

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.