Human intention recognition using context relationships in complex scenes

Tong Tong

doi:10.1016/j.eswa.2024.126147

Human intention recognition using context relationships in complex scenes

2025-03-01

0

OA

AI

童

童同 (Tong Tong)

DOI：10.1016/j.eswa.2024.126147

Original

Save

View PDF

Abstract

En 中文

Recognizing human intentions is a key challenge in human-robot interaction research. Much of the current work in this area centers on identifying human intentions within specific activities, often relying on a limited set of features. In contrast, this paper introduces a more versatile framework for intention recognition and introduces a novel model: the Spatial-Temporal Graph Attention Informer Neural Network (STGAIN). To recognize intentions, this model leverages spatial relationships between humans and objects in different scenes, along with their temporal evolution. In addition, to address an existing research gap, this research developed a new dataset called Dynamic Scene Graph (DSG) with representative dynamic relationships, derived from 471 videos covering 20 categories of human intentions. This dataset represents people and objects in different scenes, and the relationships between them. The model was tested rigorously at different points in the videos to track how the scenes evolved and to assess prediction accuracy, comparing the results to a range of advanced algorithms. Our findings clearly demonstrate that STGAIN outperforms these models, showcasing its potential for advanced human intention recognition applications. This model represents a significant advance toward creating more human-centered robots, capable of understanding and adapting to human intentions in real-world situations.

Keywords:

Human intention recognition

Dynamic scene graph dataset

Attention mechanism

Spatial temporal graph attention informer neural network

Context

Human intention recognition using context relationships in complex scenes

Abstract

AI Summary

Journal

Organization