arrow
Return

Visualization-Based Active Learning for Video Annotation

delete2016-11-01
delete23
PRE
AI
H
Hongsen Liao
陈莉 cover
陈莉 (Li Chen) *
M
Ming Hao
DOI:10.1109/TMM.2016.2614227delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Video annotation is an effective way to facilitate content-based analysis for videos. Automatic machine learning methods are commonly used to accomplish this task. Among these, active learning is one of the most effective methods, especially when the training data cost a great deal to obtain. One of the most challenging problems in active learning is the sample selection. Various sampling strategies can be used, such as uncertainty, density, and diversity, but it is difficult to strike a balance among them. In this paper, we provide a visualization-based batch mode sampling method to handle such a problem. An iso-contour-based scatterplot is used to provide intuitive clues for the representativeness and informativeness of samples and assist users in sample selection. A semisupervised metric learning method is incorporated to help generate an effective scatterplot reflecting the high-level semantic similarity for visual sample selection. Moreover, both quantitative and qualitative evaluations are provided to show that the visualization-based method can effectively enhance sample selection in active learning.
Keywords:
Active learning
projection
video annotation
visualization

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.7K
Citations:
2.4W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Cited Papers

Cited Papers

Dense Trajectories and Motion Boundary Descriptors for Action Recognition
err2013-03-06
err1.3K
errOAAI
errWang, Heng; Klaeser, Alexander; Schmid, Cordelia; Liu, Cheng-Lin
errShare
errSave
Designing 2D arrays for SHM of planar structures: a review
err2013-04-11
err0
errOAAI
errTadeusz Stepinski; Lukasz Ambrozinski; Tadeusz Uhl
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Design of a Piezoelectric-Driven Tilt Mirror for a Fast Laser Scanner
err2013-12-21
err0
PREAI
errJung-Ho Park; Hu-Seung Lee; Jae-Hoon Lee; So-Nam Yun; Young-Bog Ham; Dong-Won Yun
errShare
errSave
Three halogeno(cyano)cuprates with 1-D helical chains and their efficient luminescence
err2006-03-01
err0
PREAI
errXi Liu; Guo-Cong Guo; Ming-Lai Fu; Jian-Ping Zou; Fa-Kun Zheng; Jin-Shun Huang
errShare
errSave
Visual deficits and cognitive assessment of multiple sclerosis: confounder, correlate, or both?
err2021-02-15
err0
PREAI
errDejan Jakimovski; Ralph H. B. Benedict; Bianca Weinstock-Guttman; Osman Ozel; Tom A. Fuchs; Norah Lincoff; Niels Bergsland; Michael G. Dwyer; Robert Zivadinov
errShare
errSave
Optimization of the coherence properties of diamond samples with an intermediate concentration of NV centers
err2021-02-01
err0
errOAAI
errO.R. Rubinas; V.V. Soshenko; S.V. Bolshedvorskii; A.I. Zeleneev; A.S. Galkin; S.A. Tarelkin; S.Y. Troschiev; V.V. Vorobyov; V.N. Sorokin; A.A. Sukhanov; V.G. Vins; A.N. Smolyaninov; A.V. Akimov
errShare
errSave
researcher View more