arrow
Return

Complex Activity Recognition Via Attribute Dynamics

delete2016-06-21
delete12
PRE
AI
W
Weixin Li *
N
Nuno Vasconcelos
DOI:10.1007/s11263-016-0918-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The problem of modeling the dynamic structure of human activities is considered. Video is mapped to a semantic feature space, which encodes activity attribute probabilities over time. The binary dynamic system (BDS) model is proposed to jointly learn the distribution and dynamics of activities in this space. This is a non-linear dynamic system that combines binary observation variables and a hidden Gauss-Markov state process, extending both binary principal component analysis and the classical linear dynamic systems. A BDS learning algorithm, inspired by the popular dynamic texture, and a dissimilarity measure between BDSs, which generalizes the Binet-Cauchy kernel, are introduced. To enable the recognition of highly non-stationary activities, the BDS is embedded in a bag of words. An algorithm is introduced for learning a BDS codebook, enabling the use of the BDS as a visual word for attribute dynamics (WAD). Short-term video segments are then quantized with a WAD codebook, allowing the representation of video as a bag-of-words for attribute dynamics. Video sequences are finally encoded as vectors of locally aggregated descriptors, which summarize the first moments of video snippets on the BDS manifold. Experiments show that this representation achieves state-of-the-art performance on the tasks of complex activity recognition and event identification.
Keywords:
Complex activity
Attribute
Dynamical model
Variational inference
Fisher score
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
4.0K
Citations:
2.8W

Organization

University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
Cited Papers

Cited Papers

Xenon migration in UO2 under irradiation studied by SIMS profilometry
err2013-09-01
err0
PREAI
errB. Marchand; N. Moncoffre; Y. Pipon; N. Bérerd; C. Garnier; L. Raimbault; P. Sainsot; T. Epicier; C. Delafoy; M. Fraczkiewicz; C. Gaillard; N. Toulhoat; A. Perrat-Mabilon; C. Peaucelle
errShare
errSave
An Adaptive Semiactive Control Algorithm for Magnetorheological Suspension Systems
err2005-01-28
err0
PREAI
errXubin Song; Mehdi Ahmadian; Steve Southward; Lane R. Miller
errShare
errSave
Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
errShare
errSave
Targeting of cohesin by transcriptionally silent chromatin
err2005-11-30
err0
errOAAI
errChuang-Rung Chang; Ching-Shyi Wu; Yolanda Hom; Marc R. Gartenberg
errShare
errSave
Human Activity Analysis: A Review
err2011-04-29
err1.6K
PREAI
errAggarwal, J. K.; Ryoo, M. S.
errShare
errSave
researcher View more