arrow
Return

Workflow recognition with structured two-stream convolutional networks

delete2020-02-01
delete7
delete
OA
AI
H
Haiyang Hu
程开明 cover
程开明 (Kaiming Cheng)
Z
Zhongjin Li *
陈杰 (Jie Chen)
扈华 (Hua Hu)
DOI:10.1016/j.patrec.2018.10.011delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Intelligent monitoring plays an important role in the context of Industry 4.0 '', and behavior recognition is one of the research points in computer vision. However, monitoring the workflow of human beings and machines in production process is very difficult in the real-world complex factory environment. In this paper, we propose a novel workflow recognition framework based on the structured two-stream convolutional neural networks (CNNs) to recognize the behavior of both workers and machines. To improve the accuracy of workflow recognition, we use the CNNs to extract the spatial-temporal features and integrate an attention mechanism to detect the valuable behavior. Then, a Video Triple model is introduced to gain extra timestamp information, which can extend the behavior recognition to workflow recognition. Extensive simulation experiments are conducted on THUMOS'14 dataset and a real-world workflow dataset that show the significant performance improvement in video activity recognition. (C) 2018 Elsevier B.V. All rights reserved.
Keywords:
Workflow recognition
Action recognition
Deep learning
Two-stream CNNs
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.6K
Citations: 7.5K
Cited Papers

Cited Papers

Unsupervised Topic Hypergraph Hashing for Efficient Mobile Image Retrieval
err2017-11-01
err75
errOAAI
errZhu, Lei; Shen, Jialie; Xie, Liang; Cheng, Zhiyong
errShare
errSave
Multi-objective scheduling for scientific workflow in multicloud environment
err2018-07-01
err82
errOAAI
errHu, Haiyang; Li, Zhongjin; Hu, Hua; Chen, Jie; Ge, Jidong; Li, Chuanyi; Chang, Victor
errShare
errSave
errShare
errSave
Mo1297 Mode of Delivery in Inflammatory Bowel Disease Patients: A Population-Based Study
err2013-05-01
err0
errOAAI
errYvette Leung; Gilaad G. Kaplan; Stephanie Coward; Marie-Claude Proulx; Divine Tanyingoh; Subrata Ghosh; Remo Panaccione; Cynthia H. Seow
errShare
errSave
Discrete Multimodal Hashing With Canonical Views for Robust Mobile Landmark Search
err2017-09-01
err116
errOAAI
errZhu, Lei; Huang, Zi; Liu, Xiaobai; He, Xiangnan; Sun, Jiande; Zhou, Xiaofang
errShare
errSave
The Many Shades of Negativity
err2017-07-01
err61
PREAI
errMa, Zhigang; Chang, Xiaojun; Yang, Yi; Sebe, Nicu; Hauptmann, Alexander G.
errShare
errSave
errShare
errSave
Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization
err2014-11-13
err346
PREAI
errYang, Yi; Ma, Zhigang; Nie, Feiping; Chang, Xiaojun; Hauptmann, Alexander G.
errShare
errSave
no more