arrow
返回

Improved 3D Markerless Mouse Pose Estimation Using Temporal Semi-supervision

delete2023-02-22
delete10
delete
OA
AI
T
Tianqing Li
K
Kyle S. Severson
F
Fan Wang
T
Timothy Dunn *
DOI:10.1007/s11263-023-01756-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Three-dimensional markerless pose estimation from multi-view video is emerging as an exciting method for quantifying the behavior of freely moving animals. Nevertheless, scientifically precise 3D animal pose estimation remains challenging, primarily due to a lack of large training and benchmark datasets and the immaturity of algorithms tailored to the demands of animal experiments and body plans. Existing techniques employ fully supervised convolutional neural networks (CNNs) trained to predict body keypoints in individual video frames, but this demands a large collection of labeled training samples to achieve desirable 3D tracking performance. Here, we introduce a semi-supervised learning strategy that incorporates unlabeled video frames via a simple temporal constraint applied during training. In freely moving mice, our new approach improves the current state-of-the-art performance of multi-view volumetric 3D pose estimation and further enhances the temporal stability and skeletal consistency of 3D tracking.
Keyword:
3D pose estimation
Animal behavioral tracking
Semi-supervised learning
Markerless animal tracking

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

D
Duke University
学者数:
6.3W
论文数: 5.7W
被引数: 6.5W
引用论文

引用论文

err2008-11-01
err0
PREAI
err
err分享
err收藏
Transcription factor FOXO1 promotes cell migration toward exogenous ATP via controlling P2Y1 receptor expression in lymphatic endothelial cells
err2017-08-01
err0
PREAI
errKenta Niimi; Mizuha Ueda; Moe Fukumoto; Misaki Kohara; Toshinori Sawano; Ryo Tsuchihashi; Satoshi Shibata; Shinobu Inagaki; Tatsuo Furuyama
err分享
err收藏
err分享
err收藏
A quantitative framework for whole-body coordination reveals specific deficits in freely walking ataxic mice
err2015-10-03
err134
errOAAI
errMachado, Ana S.; Darmohray, Dana M.; Fayad, Joao; Marques, Hugo G.; Carey, Megan R.
err分享
err收藏
Prospective cohort study on the predictors of fall risk in 119 patients with bilateral vestibulopathy
err2020-03-09
err0
errOAAI
errBieke Dobbels; Florence Lucieer; Griet Mertens; Annick Gilles; Julie Moyaert; Paul van de Heyning; Nils Guinand; Angelica Pérez Fornos; Nolan Herssens; Ann Hallemans; Luc Vereeck; Olivier Vanderveken; Vincent Van Rompaey; Raymond van de Berg
err分享
err收藏
Diversity and productivity of plant communities across the Inland Northwest, USA
err2005-03-24
err0
PREAI
errMichael D. Jennings; John W. Williams; Mark R. Stromberg
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容