arrow
返回

Multi-modality learning for human action recognition

delete2020-03-02
delete38
PRE
AI
Z
Ziliang Ren
Q
Qieshi Zhang
X
Xiangyang Gao
P
Pengyi Hao
J
Jun Cheng *
DOI:10.1007/s11042-019-08576-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The multi-modality based human action recognition is an increasing topic. Multi-modality can provide more abundant and complementary information than single modality. However, it is difficult for multi-modality learning to capture the spatial-temporal information from the entire RGB and depth sequence effectively. In this paper, to obtain better representation of spatial-temporal information, we propose a bidirectional rank pooling method to construct the RGB Visual Dynamic Images (VDIs) and Depth Dynamic Images (DDIs). Furthermore, we design an effective segmentation convolutional networks (ConvNets) architecture based on multi-modality hierarchical fusion strategy for human action recognition. The proposed method has been verified and achieved the state-of-the-art results on the widely used NTU RGB+D, SYSU 3D HOI and UWA3D II datasets.
Keyword:
Multi-modality
Human action recognition
Rank pooling
Convolutional networks (ConvNets)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

C
Chinese University of Hong Kong
学者数:
3.4W
论文数: 3.2W
被引数: 5.6W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

A Quaternary aminostratigraphy constraining chronology of depositional environments in the North Sea Basin
err2018-08-01
err0
PREAI
errBenedict T.I. Reinardy; Hans Petter Sejrup; Berit O. Hjelstuen; Edward King; Hans Augedal
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
Action Recognition From Depth Maps Using Deep Convolutional Neural Networks
err2016-08-01
err235
PREAI
errWang, Pichao; Li, Wanqing; Gao, Zhimin; Zhang, Jing; Tang, Chang; Ogunbona, Philip O.
err分享
err收藏
A review study of the current research on energy hub for energy positive neighborhoods
err2017-09-01
err0
errOAAI
errShalika Walker; Timilehin Labeodan; Wim Maassen; Wim Zeiler
err分享
err收藏
err分享
err收藏
学者 查看更多内容