.png){kind=icon}
返回
rPPG-Based Heart Rate Estimation Using Spatial-Temporal Attention Network
.png){kind=icon}
PRE
AI
DOI：10.1109/TCDS.2021.3131197.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Remote photoplethysmography (rPPG) based on the computer vision technology is widely used to calculate the heart rate (HR) from facial videos. Existing rPPG techniques have been subject to some limitations [e.g., highly redundant spatial information, head movement noise, and region of interest (ROI) selection]. To address these limitations, this article introduces an effective spatial-temporal attention network. A temporal fusion module is first proposed to fully exploit the time-domain information, aiming to reduce the redundant video information and strengthen the association relationships of long-range videos. Furthermore, a spatial attention mechanism is designed in the backbone net to precisely target the skin ROIs. Finally, to assist the network in learning the weights between channels, we project the RGB images using the plane orthogonal to skin (POS) algorithm and add motion representation to complement physiological signals' extraction. The extensive experiments on the public PURE, MMSE-HR, and UBFC-rPPG datasets demonstrate that our model achieves competitive results compared with other methods.
Keyword:
Heart rate
Videos
Cameras
Neural networks
Estimation
Deep learning
Physiology
Spatiotemporal phenomena
Photoplethysmography
Deep neural networks
heart rate (HR) estimation
remote photoplethysmography (rPPG)
spatial-temporal attention
期刊
IF:
4.9
论文数:
1.1K
被引数:
3.5K
机构
引用论文
.png){kind=icon}
Beyond the Patchwise Classification: Spectral-Spatial Fully Convolutional Networks for Hyperspectral Image Classification超越Patchwise分类: 用于高光谱图像分类的光谱空间完全卷积网络
PREAI
分享收藏分享收藏
查看更多内容