arrow
返回

Variational Abnormal Behavior Detection With Motion Consistency

delete2022-01-01
delete30
PRE
AI
李菁 封面图
李菁 (Jing Li)
Q
Qingwang Huang
Y
Yingjun Du
X
Xiantong Zhen *
S
Shengyong Chen
Ling Shao 封面图
Ling Shao (Ling Shao)
DOI:10.1109/TIP.2021.3130545delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Abnormal crowd behavior detection has recently attracted increasing attention due to its wide applications in computer vision research areas. However, it is still an extremely challenging task due to the great variability of abnormal behavior coupled with huge ambiguity and uncertainty of video contents. To tackle these challenges, we propose a new probabilistic framework named variational abnormal behavior detection (VABD), which can detect abnormal crowd behavior in video sequences. We make three major contributions: (1) We develop a new probabilistic latent variable model that combines the strengths of the U-Net and conditional variational auto-encoder, which also are the backbone of our model; (2) We propose a motion loss based on an optical flow network to impose the motion consistency of generated video frames and input video frames; (3) We embed a Wasserstein generative adversarial network at the end of the backbone network to enhance the framework performance. VABD can accurately discriminate abnormal video frames from video sequences. Experimental results on UCSD, CUHK Avenue, IITB-Corridor, and ShanghaiTech datasets show that VABD outperforms the state-of-the-art algorithms on abnormal crowd behavior detection. Without data augmentation, our VABD achieves 72.24% in terms of AUC on IITB-Corridor, which surpasses the state-of-the-art methods by nearly 5%.
Keyword:
Feature extraction
Probabilistic logic
Video sequences
Image reconstruction
Anomaly detection
Training
Optical losses
Abnormal crowd behavior detection
conditional variational auto-encoder
optical flow network
motion loss
Wasserstein generative adversarial network

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

N
Nanchang University
学者数:
3.7W
论文数: 2.1W
被引数: 3.7W
U
university of amsterdam
学者数:
6.0W
论文数: 5.1W
被引数: 94
T
Tianjin University of Technology
学者数:
8.8K
论文数: 5.9K
被引数: 1.0W
学者 查看更多机构
引用论文

引用论文

Analysis of an N-terminal deletion in subunit a of the Escherichia coli ATP synthase
err2017-01-11
err0
errOAAI
errRobert R. Ishmukhametov; Jessica DeLeon-Rangel; Shaotong Zhu; Steven B. Vik
err分享
err收藏
Micromachined sapphire GHz lateral overtone bulk acoustic resonators transduced by aluminum nitride
err2012-01-01
err0
PREAI
errNai-Kuei Kuo; Songbin Gong; Jeffrey Hartman; James Kelliher; Wayne Miller; Justin Parke; Silai V. Krishaswamy; John D. Adam; Gianluca Piazza
err分享
err收藏
Crowd Abnormal Behaviour Identification Based on Integral Optical Flow in Video Surveillance Systems
err2018-01-01
err6
PREAI
errChen, Huafeng; Nedzvedz, Olga; Ye, Shiping; Ablameyko, Sergey
err分享
err收藏
When Does Model-Based Control Pay Off?
err2016-08-26
err0
errOAAI
errWouter Kool; Fiery A. Cushman; Samuel J. Gershman
err分享
err收藏
学者 查看更多内容