.png){kind=icon}
返回
Single Image Depth Map Estimation for Improving Posture Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/JSEN.2021.3122128.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Image-based posture recognition is a very challenging problem since it is difficult to acquire rich 3D information from the posture in color image. To address this issue, we present a novel and unified framework for human posture recognition, applying single image depth map estimation from color images. The proposed method includes two stages. The first stage estimates the depth map from the single-color image by an improved Pix2Pix generation module. The generation module is equipped with a hybrid loss function that captures the high-level features and recovers the sharp depth discontinuities, thus improving the depth estimation results. The second stage (the recognition stage) improves the color image-based recognition performance by incorporating the estimated depth map. Thereby, a two-stream CNN architecture that separately processes the color image and its estimated depth image is developed for robust posture recognition. To verify its effectiveness, we first test the proposed method on a novel pose dataset, which contains 13800 samples of paired color-and-depth of 6 subjects with 15 poses. The dataset used in this work is been created and released, is available at http://media.ritsumei.ac.jp/iipl/database/pose/. Extensive experiments are also performed on the public OUHANDS hand gesture dataset. Experiments demonstrate that the proposed method achieves superior performance on both human pose and hand gesture recognition tasks.
Keyword:
Image recognition
Color
Generative adversarial networks
Estimation
Generators
Feature extraction
Sensors
Depth map estimation
pose classification
two-stream
fusion
convolutional neural network (CNN)
improved Pix2pix
期刊
IF:
4.5
论文数:
2.2W
被引数:
7.3W
机构
引用论文
On the nature of high-temperature structural transitions in polymers and copolymers of butadiene
PREAI
分享收藏分享收藏
Is SA shared or distributed in team work? An exploratory study in an intelligence analysis task
PREAI
分享收藏Generation of human depth images with body part labels for complex human pose recognition.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容