.png){kind=icon}
返回
Under the Cover Infant Pose Estimation Using Multimodal Data
.png){kind=icon}
OA
AI
DOI：10.1109/TIM.2023.3244220.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Infant pose monitoring during sleep has multiple applications in both healthcare and home settings. In a healthcare setting, pose detection can be used for region-of-interest (ROI) detection and movement detection for noncontact-based monitoring systems. In a home setting, pose detection can be used to detect sleep positions, which has shown to have a strong influence on multiple health factors. However, pose monitoring during sleep is challenging due to heavy occlusions from blanket coverings and low lighting. To address this, we present a novel dataset, Simultaneously-collected multimodal Mannequin Lying pose (SMaL) dataset, for under-the-cover infant pose estimation. We collect depth and pressure imagery of an infant mannequin in different poses under various cover conditions. We successfully infer full body pose under the cover by training state-of-the-art pose estimation methods and leveraging existing multimodal adult pose datasets for transfer learning. We demonstrate a hierarchical pretraining strategy for transformer-based models to significantly improve performance on our dataset. Our best-performing model was able to detect joints under the cover within 25 mm 86% of the time with an overall mean error of 16.9 mm. Data, code, and models are publicly available at https://github.com/DanielKyr/SMaL.
Keyword:
Pose estimation
Pediatrics
Sensors
Monitoring
Transformers
Task analysis
Sleep apnea
Depth sensing
infant pose estimation
multimodal data
pressure mapping
pretraining
vision transformers (ViTs)
期刊
IF:
5.9
论文数:
1.9W
被引数:
5.8W
机构
引用论文
.png){kind=icon}
Use of interactive sessions and e‐learning in teaching anatomy to first‐year optometry students
PREAI
分享收藏
Research on the Efficiency of Wireless Power Transfer System Based on Multi-Auxiliary Transmitting Coils基于多辅助发射线圈的无线电能传输系统效率研究
PREAI
分享收藏
查看更多内容