arrow
Return

Variational Abnormal Behavior Detection With Motion Consistency

delete2022-01-01
delete30
PRE
AI
李菁 cover
李菁 (Jing Li)
Q
Qingwang Huang
Y
Yingjun Du
X
Xiantong Zhen *
S
Shengyong Chen
Ling Shao cover
Ling Shao (Ling Shao)
DOI:10.1109/TIP.2021.3130545delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Abnormal crowd behavior detection has recently attracted increasing attention due to its wide applications in computer vision research areas. However, it is still an extremely challenging task due to the great variability of abnormal behavior coupled with huge ambiguity and uncertainty of video contents. To tackle these challenges, we propose a new probabilistic framework named variational abnormal behavior detection (VABD), which can detect abnormal crowd behavior in video sequences. We make three major contributions: (1) We develop a new probabilistic latent variable model that combines the strengths of the U-Net and conditional variational auto-encoder, which also are the backbone of our model; (2) We propose a motion loss based on an optical flow network to impose the motion consistency of generated video frames and input video frames; (3) We embed a Wasserstein generative adversarial network at the end of the backbone network to enhance the framework performance. VABD can accurately discriminate abnormal video frames from video sequences. Experimental results on UCSD, CUHK Avenue, IITB-Corridor, and ShanghaiTech datasets show that VABD outperforms the state-of-the-art algorithms on abnormal crowd behavior detection. Without data augmentation, our VABD achieves 72.24% in terms of AUC on IITB-Corridor, which surpasses the state-of-the-art methods by nearly 5%.
Keywords:
Feature extraction
Probabilistic logic
Video sequences
Image reconstruction
Anomaly detection
Training
Optical losses
Abnormal crowd behavior detection
conditional variational auto-encoder
optical flow network
motion loss
Wasserstein generative adversarial network

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

N
Nanchang University
Scholars:
3.7W
Papers: 2.1W
Citations: 3.7W
U
university of amsterdam
Scholars:
6.0W
Papers: 5.1W
Citations: 94
T
Tianjin University of Technology
Scholars:
8.8K
Papers: 5.9K
Citations: 1.0W
researcher View more organizations
Cited Papers

Cited Papers

Analysis of an N-terminal deletion in subunit a of the Escherichia coli ATP synthase
err2017-01-11
err0
errOAAI
errRobert R. Ishmukhametov; Jessica DeLeon-Rangel; Shaotong Zhu; Steven B. Vik
errShare
errSave
Micromachined sapphire GHz lateral overtone bulk acoustic resonators transduced by aluminum nitride
err2012-01-01
err0
PREAI
errNai-Kuei Kuo; Songbin Gong; Jeffrey Hartman; James Kelliher; Wayne Miller; Justin Parke; Silai V. Krishaswamy; John D. Adam; Gianluca Piazza
errShare
errSave
Crowd Abnormal Behaviour Identification Based on Integral Optical Flow in Video Surveillance Systems
err2018-01-01
err6
PREAI
errChen, Huafeng; Nedzvedz, Olga; Ye, Shiping; Ablameyko, Sergey
errShare
errSave
When Does Model-Based Control Pay Off?
err2016-08-26
err0
errOAAI
errWouter Kool; Fiery A. Cushman; Samuel J. Gershman
errShare
errSave
researcher View more