arrow
Return

An Efficient Human Instance-Guided Framework for Video Action Recognition

delete2021-12-12
delete6
delete
OA
AI
I
Inwoong Lee
D
Doyoung Kim
D
Dongyoon Wee
S
Sanghoon Lee *
DOI:10.3390/s21248309delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In recent years, human action recognition has been studied by many computer vision researchers. Recent studies have attempted to use two-stream networks using appearance and motion features, but most of these approaches focused on clip-level video action recognition. In contrast to traditional methods which generally used entire images, we propose a new human instance-level video action recognition framework. In this framework, we represent the instance-level features using human boxes and keypoints, and our action region features are used as the inputs of the temporal action head network, which makes our framework more discriminative. We also propose novel temporal action head networks consisting of various modules, which reflect various temporal dynamics well. In the experiment, the proposed models achieve comparable performance with the state-of-the-art approaches on two challenging datasets. Furthermore, we evaluate the proposed features and networks to verify the effectiveness of them. Finally, we analyze the confusion matrix and visualize the recognized actions at human instance level when there are several people.
Keywords:
human detection
multiple human tracking
human action recognition
convolutional neural network
temporal sequence analysis
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.1W
Citations:
20.9W

Organization

N
naver
Scholars:
152
Papers: 129
Citations: 1
Y
Yonsei University
Scholars:
4.8W
Papers: 4.6W
Citations: 5.2W