arrow
Return

Light-Adaptive Human Body Key Point Detection Algorithm Based on Multi-Source Information Fusion

delete2024-05-10
delete3
delete
OA
AI
胡志刚 (Zhigang Hu)
C
Chengwu Zhang
X
Xinzheng Wang *
A
Aoru Ge
DOI:10.3390/s24103021delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The identification of key points in the human body is vital for sports rehabilitation, medical diagnosis, human-computer interaction, and related fields. Currently, depth cameras provide more precise depth information on these crucial points. However, human motion can lead to variations in the positions of these key points. While the Mediapipe algorithm demonstrates effective anti-shake capabilities for these points, its accuracy can be easily affected by changes in lighting conditions. To address these challenges, this study proposes an illumination-adaptive algorithm for detecting human key points through the fusion of multi-source information. By integrating key point data from the depth camera and Mediapipe, an illumination change model is established to simulate environmental lighting variations. Subsequently, the fitting function of the relationship between lighting conditions and adaptive weights is solved to achieve lighting adaptation for human key point detection. Experimental verification and similarity analysis with benchmark data yielded R2 results of 0.96 and 0.93, and cosine similarity results of 0.92 and 0.90. With a threshold range of 8, the joint accuracy rates for the two rehabilitation actions were found to be 89% and 88%. The experimental results demonstrate the stability of the proposed method in detecting key points in the human body under changing illumination conditions, its anti-shake ability for human movement, and its high detection accuracy. This method shows promise for applications in human-computer interaction, sports rehabilitation, and virtual reality.
Keywords:
information fusion
lighting adaptation
key point detection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.1W
Citations:
20.9W

Organization

No organization information available