.png){kind=icon}
Return
Human-Object interaction detection algorithm based on visual-semantic interaction perception
.png){kind=icon}
PRE
AI
DOI：10.1007/s11760-025-04804-2.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
To address the challenges of inadequate extraction of features from interaction regions due to occlusion and the limited generalization in small-sample training, we propose a human-object interaction detection algorithm based on visual-semantic interaction perception. To improve the extraction of interaction region features hindered by occlusion, we propose a Deep Visual Interaction Feature Extraction Network(DVIF). Using graph convolution to develop an adaptable human-object relationship graph, paired with an optimized human pose segment, allows us to better capture significant interaction region characteristics. To enhance the generalization ability of small sample training data, a Semantic-driven Sample Expansion Module (SSE) is proposed. This module incorporates word embeddings and linguistic priors into data generation to augment the training samples. We propose a Cross-modal External Attention Fusion Module (CEA) to synergistically enhance visual and semantic information, thereby improving the accuracy and robustness of interaction detection. Experiments on the HICO-DET and V-COCO datasets achieved human-object interaction detection accuracy of 30.67% and 60.3%, demonstrating the effectiveness of the proposed algorithm.
Keywords:
Human-Object interaction detection algorithm
Deep visual interaction feature extraction
Graph convolutional network
Pose estimation
Semantic-driven sample expansion
Cross-modal external attention fusion
Journal
IF:
2.1
Papers:
908
Citations:
4.6K
Organization
No organization information available
Cited Papers
.png){kind=icon}
Human object interaction detection based on feature optimization and key human-object enhancement
PREAI
ShareSave
View more