arrow
Return

Deep Imputation for Skeleton data (DISK) for behavioral science

delete2025-12-04
delete0
delete
OA
AI
F
France Rose *
M
Monika Michaluk
T
Timon Blindauer
B
Bogna M. Ignatowska‐Jankowska
L
Liam O’Shaughnessy
G
Greg J. Stephens
T
Talmo Pereira
M
Marylka Yoe Uusisaari
K
Katarzyna Bożek *
DOI:10.1038/s41592-025-02893-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Pose estimation methods and motion capture systems have opened doors to quantitative measurements of animal kinematics. While animal behavior experiments are expensive and complex, tracking errors sometimes make large portions of the experimental data unusable. Here our deep learning method, Deep Imputation for Skeleton data (DISK), uncovers dependencies between keypoints and their dynamics to impute missing tracking data without the help of any manual annotations. We demonstrate the utility and performance of DISK on seven animal skeletons including multi-animal setups. The imputed recordings allow us to detect more episodes of motion, such as steps, and obtain more statistically robust results when comparing these episodes between experimental conditions. In addition, by learning to impute the missing content, DISK learns meaningful representations of the data capturing, for example, underlying actions. This stand-alone imputation package, available at https://github.com/bozeklab/DISK.git/ , is applicable to outputs of tracking methods (marker-based or markerless) and allows for varied types of downstream analysis. Analysis of behavioral data often involves tracking animal keypoints in video and motion capture recordings. DISK imputes missing keypoints, thereby improving downstream analyses.
Keywords:
Computational neuroscience
Machine learning
Life Sciences
general
Biological Techniques
Biological Microscopy
Biomedical Engineering/Biotechnology
Bioinformatics
Proteomics

Journal

Nature Methods cover
Nature Methods
IF:
32.1
Papers:
7.2K
Citations:
12.7W

Organization

F
Faculty of Medicine and University Hospital Cologne
Scholars:
312
Papers: 75
Citations: 5
U
University of Warsaw
Scholars:
1.2W
Papers: 1.0W
Citations: 1.1W
V
VU University Amsterdam
Scholars:
25
Papers: 17
Citations: 0
S
Salk Institute for Biological Studies
Scholars:
343
Papers: 96
Citations: 1
O
Okinawa Institute of Science and Technology
Scholars:
160
Papers: 86
Citations: 8
researcher View more organizations