arrow
Return

KAMTFENet: a fall detection algorithm based on keypoint attention module and temporal feature extraction

delete2022-12-02
delete9
PRE
AI
J
Jiangjiao Li
M
Mengqi Gao
李彬 cover
李彬 (Bin Li) *
D
Dazheng Zhou
Y
Yumin Zhi
张友梅 (Youmei Zhang)
DOI:10.1007/s13042-022-01730-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Falls have become the second leading cause of accidental death of the elderly. The serious consequences of falls in the elders can be reduced effectively if they can be detected early. This paper proposes a fall detection method based on keypoint attention module and temporal feature extraction. Firstly, the object detection model (YOLOv3) and the pose estimation model (Multi-stage Pose Estimation Network) are used to obtain the body keypoints. Then, we design a sliding window to preprocess the keypoints. The sliding window divides the keypoints in 30 consecutive frames into a group so that the subsequent network can extract the dynamic features from the keypoints. After that, an adaptive keypoint attention module is designed to strengthen the fall-related keypoints. We improve the long-short-term memory network, and utilize it on the strengthened features to extract the dynamic temporal features. Finally, the fully connected layers are used to recognize falls and normal poses. Experimental results show that the proposed approach achieves an accuracy of 99.73% and 99.62% when tested with UR Fall Detection Dataset and Le2i Fall Detection Dataset.
Keywords:
Keypoints
Sliding window
Attention
Temporal features

Journal

International Journal of Machine Learning and Cybernetics cover
International Journal of Machine Learning and Cybernetics
IF:
2.7
Papers:
3.1K
Citations:
5.6K

Organization

Q
Qilu University of Technology
Scholars:
1.1W
Papers: 8.9K
Citations: 16