返回
Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-supervision
DOI:10.1007/s11263-023-01756-3.png)
摘要
En 中文
Three-dimensional markerless pose estimation from multi-view video is emerging as an exciting method for quantifying the behavior of freely moving animals. Nevertheless, scientifically precise 3D animal pose estimation remains challenging, primarily due to a lack of large training and benchmark datasets and the immaturity of algorithms tailored to the demands of animal experiments and body plans. Existing techniques employ fully supervised convolutional neural networks (CNNs) trained to predict body keypoints in individual video frames, but this demands a large collection of labeled training samples to achieve desirable 3D tracking performance. Here, we introduce a semi-supervised learning strategy that incorporates unlabeled video frames via a simple temporal constraint applied during training. In freely moving mice, our new approach improves the current state-of-the-art performance of multi-view volumetric 3D pose estimation and further enhances the temporal stability and skeletal consistency of 3D tracking.
Keyword:
3D pose estimation
Animal behavioral tracking
Semi-supervised learning
Markerless animal tracking
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
IF0
LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animalsLiftPose3D,一种基于深度学习的方法,用于将实验动物的二维姿势转换为三维姿势
NATURE METHODS
IF32.1
A quantitative framework for whole-body coordination reveals specific deficits in freely walking ataxic mice
ELIFE
IF0
Prospective cohort study on the predictors of fall risk in 119 patients with bilateral vestibulopathy
PLOS ONE
IF0

