arrow
Return

Memory-enhanced spatial-temporal encoding framework for industrial anomaly detection system

delete2024-09-01
delete2
PRE
AI
Y
Yang Liu
B
Bobo Ju
D
Dingkang Yang
L
Liyuan Peng
D
Di Li
P
Peng Sun
C
Chengfang Li
H
Hao Yang
J
Jing Liu
L
Liang Song *
DOI:10.1016/j.eswa.2024.123718delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The development of modern manufacturing has raised greater demands on the accuracy, response speed, and operating cost of industrial accident warnings. Compared to conventional contact sensors, surveillance cameras can contactlessly capture spatial-temporal information of the open workspace with stable data quality, widely used in industrial process monitoring. However, due to the scarcity of industrial video datasets and the rarity and diversity of abnormal events, existing video -based anomaly detection models perform poorly in manufacturing scenarios. In this regard, we collect two datasets from typical industrial sites and propose a memory -enhanced spatial-temporal encoding (MSTE) framework for automatic industrial anomaly detection. The proposed MSTE framework learns spatial and temporal normality as well as spatial-temporal correlations with parallel structures and simultaneously measures deviations in appearance, motion, and consistency to respond to complex industrial anomalies accurately. Experimental results on public benchmarks and realworld industrial videos show that our method outperforms existing methods and achieves accurate temporal localization of various spatial-temporal anomalies, which helps to improve the safety and reliability of intelligent manufacturing.
Keywords:
Industrial anomaly detection
Intelligent information system
Spatial-temporal anomaly detection
Deep autoencoder
Normality learning

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

F
fudan university
Scholars:
11.8W
Papers: 7.7W
Citations: 121
D
Duke Kunshan University
Scholars:
1.1K
Papers: 998
Citations: 1.5K
N
Ningbo University
Scholars:
2.6W
Papers: 1.8W
Citations: 2.4W
researcher View more organizations
Cited Papers

Cited Papers

Analysis of an N-terminal deletion in subunit a of the Escherichia coli ATP synthase
err2017-01-11
err0
errOAAI
errRobert R. Ishmukhametov; Jessica DeLeon-Rangel; Shaotong Zhu; Steven B. Vik
errShare
errSave
Target and source modality co-reinforcement for emotion understanding from asynchronous multimodal sequences
err2023-04-01
err31
PREAI
errYang, Dingkang; Liu, Yang; Huang, Can; Li, Mingcheng; Zhao, Xiao; Wang, Yuzheng; Yang, Kun; Wang, Yan; Zhai, Peng; Zhang, Lihua
errShare
errSave
Two-stream deep spatial-temporal auto-encoder for surveillance video abnormal event detection
err2021-06-01
err42
PREAI
errLi, Tong; Chen, Xinyue; Zhu, Fushun; Zhang, Zhengyu; Yan, Hua
errShare
errSave
Video anomaly detection based on spatio-temporal relationships among objects
err2023-05-01
err32
PREAI
errWang, Yang; Liu, Tianying; Zhou, Jiaogen; Guan, Jihong
errShare
errSave
Stochastic video normality network for abnormal event detection in surveillance videos
err2023-11-01
err10
PREAI
errLiu, Yang; Yang, Dingkang; Fang, Gaoyun; Wang, Yuzheng; Wei, Donglai; Zhao, Mengyang; Cheng, Kai; Liu, Jing; Song, Liang
errShare
errSave
err
IF0
err
err0
errOAAI
err
errShare
errSave
researcher View more