arrow
Return

Event-driven weakly supervised video anomaly detection

delete2024-09-01
delete0
PRE
AI
S
Shengyang Sun
龚
龚小谨 (Xiaojin Gong) *
DOI:10.1016/j.imavis.2024.105169delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Inspired by the observations of human working manners, this work proposes an event-driven method for weakly supervised video anomaly detection. Complementary to the conventional snippet-level anomaly detection, this work designs an event analysis module to predict the event-level anomaly scores as well. It first generates event proposals simply via a temporal sliding window and then constructs a cascaded causal transformer to capture temporal dependencies for potential events of varying durations. Moreover, a dual-memory augmented selfattention scheme is also designed to capture global semantic dependencies for event feature enhancement. The network is learned with a standard multiple instance learning (MIL) loss, together with normal-abnormal contrastive learning losses. During inference, the snippet- and event-level anomaly scores are fused for anomaly detection. Experiments show that the event-level analysis helps to detect anomalous events more continuously and precisely. The performance of the proposed method on three public datasets demonstrates that the proposed approach is competitive with state-of-the-art methods.
Keywords:
Video anomaly detection
Weakly supervised
Transformer
Event-driven

Journal

Image and Vision Computing cover
Image and Vision Computing
IF:
4.2
Papers:
4.1K
Citations:
6.7K

Organization

Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
Cited Papers

Cited Papers

Intelligent video anomaly detection and classification using faster RCNN with deep reinforcement learning model
err2021-08-01
err91
PREAI
errMansour, Romany F.; Escorcia-Gutierrez, Jose; Gamarra, Margarita; Villanueva, Jair A.; Leal, Nallig
errShare
errSave
Spatial-temporal graph attention network for video anomaly detection
err2023-03-01
err14
PREAI
errChen, Haoyang; Mei, Xue; Ma, Zhiyuan; Wu, Xinhong; Wei, Yachuan
errShare
errSave
Weakly Supervised Video Anomaly Detection via Self-Guided Temporal Discriminative Transformer
err2024-05-01
err16
PREAI
errHuang, Chao; Liu, Chengliang; Wen, Jie; Wu, Lian; Xu, Yong; Jiang, Qiuping; Wang, Yaowei
errShare
errSave
Anomaly detection in surveillance video based on bidirectional prediction
err2020-06-01
err69
PREAI
errChen, Dongyue; Wang, Pengtao; Yue, Lingyi; Zhang, Yuxin; Jia, Tong
errShare
errSave
Contrastive Attention for Video Anomaly Detection
err2022-01-01
err30
PREAI
errChang, Shuning; Li, Yanchao; Shen, Shengmei; Feng, Jiashi; Zhou, Zhiying
errShare
errSave
Self-trained prediction model and novel anomaly score mechanism for video anomaly detection
err2022-03-01
err24
PREAI
errGuo, Aibin; Guo, Lijun; Zhang, Rong; Wang, Yirui; Gao, Shangce
errShare
errSave
no more