arrow
返回

MobiRFPose: Portable RF-Based 3D Human Pose Camera

delete2024-01-01
delete0
PRE
AI
C
Cong Yu
D
Dongheng Zhang
Z
Zhi Wu
C
Chunyang Xie
Z
Zhi Lu
Y
Yang Hu
Y
Yan Chen *
DOI:10.1109/TMM.2023.3314979delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing RF-based human pose estimation methods usually require intensive computations and cannot meet the real-time processing and portability requirements for mobile devices. To tackle the limitation, in this article, we introduce a lightweight RF-based pose estimation model, i.e., MobiRFPose, to construct the portable RF-based pose camera. Different from traditional optical-based cameras, the RF-based camera does not capture visual information, which means the privacy-preserving characteristic. Specifically, we only utilize a horizontal antenna array to transceive RF signals, then estimate the human locations on the RF signal heatmap and crop the human location regions, and finally estimate the fine-grained human poses based on the cropped small RF signal heatmaps. To evaluate the performance, we compare MobiRFPose with state-of-the-art methods. Experimental results demonstrate that MobiRFPose can achieve accurate 3D human pose estimation with fewer parameters and computations. We also test the trained MobiRFPose model using mobile computing devices, where the model structures and parameters only take up 268 KB and 3226 KB of disk space, and MobiRFPose can achieve 66 FPS processing speed. The pose estimation error is 11.05 cm in the case of a single person and 11.29 cm in the case of multiple people. All experimental results indicate that our proposed method can construct a portable RF camera to estimate human poses accurately.
Keyword:
RF signals
Three-dimensional displays
Antenna arrays
Pose estimation
Radio frequency
Cameras
Computational modeling
Human pose estimation
lightweight model
wireless sensing

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

C
Chinese Academy of Engineering Physics
学者数:
1.1W
论文数: 8.6K
被引数: 12
U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Calibrating Phase Offsets for Commodity WiFi
err2020-03-01
err53
PREAI
errZhang, Dongheng; Hu, Yang; Chen, Yan; Zeng, Bing
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容