HTDiff: Self-Guiding Diffusion Models for Hand Trajectory Prediction

doi:10.1007/978-981-95-3102-8_9

HTDiff: Self-Guiding Diffusion Models for Hand Trajectory Prediction

2026-01-01

0

PRE

AI

DOI：10.1007/978-981-95-3102-8_9

Original

Original request for help

Save

Abstract

En 中文

Understanding human behavior is pivotal to the development of embodied artificial intelligence. Hand trajectories, as a critical medium of human interaction, offer a valuable lens through which to explore and interpret human actions. In this work, we propose a self-guided diffusion model for hand trajectory prediction (HTDiff). HTDiff consists of two main stages: The unconditional trajectory reconstruction stage learns from existing hand motion data to generate trajectory samples that conform to human motion patterns. In the conditional trajectory prediction stage, historical trajectories serve as contextual information to adaptively guide the pretrained reconstruction model in predicting future hand trajectories. Furthermore, we employ a Transformer architecture as the decoder within the diffusion model to fully exploit its strengths in sequence modeling, enabling the capture of temporal dependencies and complex motion patterns. Experiments conducted on public datasets reveal that HTDiff surpasses existing baseline methods in hand trajectory prediction, achieving the best performance across four evaluation metrics.

Keywords:

Hand Trajectory Prediction

Diffusion Models

Conditional Generation

HTDiff: Self-Guiding Diffusion Models for Hand Trajectory Prediction

Abstract

Journal

Organization