.png){kind=icon}
返回
Efficient Human Vision Inspired Action Recognition Using Adaptive Spatiotemporal Sampling
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2023.3310661.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Adaptive sampling that exploits the spatiotemporal redundancy in videos is critical for always-on action recognition on wearable devices with limited computing and battery resources. The commonly used fixed sampling strategy is not context-aware and may under-sample the visual content, and thus adversely impacts both computation efficiency and accuracy. Inspired by the concepts of foveal vision and pre-attentive processing from the human visual perception mechanism, we introduce a novel adaptive spatiotemporal sampling scheme for efficient action recognition. Our system pre-scans the global scene context at low-resolution and decides to skip or request high-resolution features at salient regions for further processing. We validate the system on EPIC-KITCHENS and UCF-101 (split-1) datasets for action recognition, and show that our proposed approach can greatly speed up inference with a tolerable loss of accuracy compared with those from state-of-the-art baselines. Source code is available in https://github.com/knmac/adaptive_spatiotemporal.
Keyword:
Adaptive sampling
spatiotemporal
action recognition
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
.png){kind=icon}
Bio‐inspired routing protocol for WSN‐based smart grid applications in the context of Industry 4.0
PREAI
分享收藏Auditory information processing during human sleep as revealed by event-related brain potentials
PREAI
分享收藏
查看更多内容