arrow
Return

Deep Manifold Structure Transfer for Action Recognition

delete2019-09-01
delete28
delete
OA
AI
C
Ce Li
张
张宝昌 (Baochang Zhang) *
C
Chen Chen
Qixiang Ye cover
Qixiang Ye (Qixiang Ye)
韩
韩军功 (Jungong Han)
G
Guodong Guo
R
Rongrong Ji
DOI:10.1109/TIP.2019.2912357delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
While intrinsic data structure in subspace provides useful information for visual recognition, it has not yet been well studied in deep feature learning for action recognition. In this paper, we introduce a new spatio-temporal manifold network (STMN) that leverages data manifold structures to regularize deep action feature learning, aiming at simultaneously minimizing the intra-class variations of learned deep features and alleviating the over-fitting problem. To this end, the manifold prior is imposed from the top layer of a convolutional neural network (CNN) and propagated across convolutional layers during forward-backward propagation. The observed correspondence of manifold structures in the data space and feature space validates that the manifold priori can he transferred across the CNN layers. The STMN theoretically recasts the problem of transferring the data structure prior into the deep learning architectures as a projection over the manifold via an embedding method, which can be easily solved by an alternating direction method of multipliers and backward propagation (ADMM-BP) algorithm. The STMN is generic in the sense that it can be plugged into various backbone architectures to learn more discriminative representation for action recognition. The extensive experimental results show that our method achieves comparable or even better performance compared with the state-of-the-art approaches on four benchmark datasets.
Keywords:
Action recognition
manifold
alternating direction method of multipliers
backward propagation
ADMM-BP
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
L
Lancaster University
Scholars:
9.5K
Papers: 1.1W
Citations: 1.7W
U
university of north carolina
Scholars:
7.4W
Papers: 6.5W
Citations: 93
U
University of North Carolina Charlotte
Scholars:
3.0K
Papers: 2.5K
Citations: 2
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Phase composition and conductivity of sputtered tantalum
err1970-05-01
err0
PREAI
errW.D. Westwood; F.C. Livermore
errShare
errSave
Acute renal allograft rejections with major interstitial oedema and plasma cell-rich infiltrates: high  -interferon expression and poor clinical outcome
err2004-03-18
err0
PREAI
errD. Desvaux; S. Le Gouvello; M. Pastural; M. Abtahi; C. Suberbielle; N. Boeri; P. Remy; L. Salomon; P. Lang; C. Baron
errShare
errSave
Dense Trajectories and Motion Boundary Descriptors for Action Recognition
err2013-03-06
err1.3K
errOAAI
errWang, Heng; Klaeser, Alexander; Schmid, Cordelia; Liu, Cheng-Lin
errShare
errSave
Climate policy: Steps to China's carbon peak
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
errShare
errSave
researcher View more