.png){kind=icon}
Return
A Real-time skeleton-based fall detection algorithm based on temporal convolutional networks and transformer encoder
.png){kind=icon}
PRE
AI
DOI：10.1016/j.pmcj.2025.102016.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
As the population of older individuals living independently rises, coupled with the heightened risk of falls among this demographic, the need for automatic fall detection systems becomes increasingly urgent to ensure timely medical intervention. Computer vision (CV)-based methodologies have emerged as a preferred approach among researchers due to their contactless and pervasive nature. However, existing CV-based solutions often suffer from either poor robustness or prohibitively high computational requirements, impeding their practical implementation in elderly living environments. To address these challenges, we introduce TCNTE, a real-time skeleton-based fall detection algorithm that combines Temporal Convolutional Network (TCN) with Transformer Encoder (TE). We also successfully mitigate the severe class imbalance issue by implementing weighted focal loss. Cross-validation on multiple publicly available vision-based fall datasets demonstrates TCNTE's superiority over individual models (TCN and TE) and existing state-of-the-art fall detection algorithms, achieving remarkable accuracies (front view of UPFall: 99.58 %; side view of UP-Fall: 98.75 %; Le2i: 97.01 %; GMDCSA-24: 92.99 %) alongside practical viability. Visualizations using t-distributed stochastic neighbor embedding (t-SNE) reveal TCNTE's superior separation margin and cohesive clustering between fall and non-fall classes compared to TCN and TE. Crucially, TCNTE is designed for pervasive deployment in mobile and resource-constrained environments. Integrated with YOLOv8 pose estimation and BoT-SORT human tracking, the algorithm operates on NVIDIA Jetson Orin NX edge device, achieving an average frame rate of 19 fps for single-person and 17 fps for two-person scenarios. With its validated accuracy and impressive real-time performance, TCNTE holds significant promise for practical fall detection applications in older adult care settings.
Keywords:
Aging
Fall detection
Pose estimation
Temporal convolutional network
Transformer
Edge computing
Journal
IF:
3.5
Papers:
1.5K
Citations:
2.2K
Organization
Cited Papers
ShareSaveA comprehensive comparison of accuracy and practicality of different types of algorithms for pre-impact fall detection using both young and old adults.png)
MEASUREMENT
MEASUREMENTIF5.6
PREAI
ShareSaveDried Brown Seaweed’s Phytoremediation Potential for Methylene Blue Dye Removal from Aquatic EnvironmentsPolymers
OAAI
PolymersIF0
OAAIShareSaveShareSaveShareSave
View more