arrow
Return

Proposal Complementary Action Detection

delete2020-06-21
delete3
PRE
AI
S
Suguo Zhu *
X
Xiaoxian Yang
J
Jun Yu
Z
Zhenying Fang
王萌 (Meng Wang)
Q
Qingming Huang
DOI:10.1145/3361845delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Temporal action detection not only requires correct classification but also needs to detect the start and end times of each action accurately. However, traditional approaches always employ sliding windows or actionness to predict the actions, and it is different to train to model with sliding windows or actionness by end-toend means. In this article, we attempt a different idea to detect the actions end-to-end, which can calculate the probabilities of actions directly through one network as one part of the results. We present PCAD, a novel proposal complementary action detector to deal with video streams under continuous, untrimmed conditions. Our approach first uses a simple fully 3D convolutional network to encode the video streams and then generates candidate temporal proposals for activities by using anchor segments. To generate more precise proposals, we also design a boundary proposal network to offer some complementary information for the candidate proposals. Finally, we learn an efficient classifier to classify the generated proposals into different activities and refine their temporal boundaries at the same time. Our model can achieve end-to-end training by jointly optimizing classification loss and regression loss. When evaluating on the THUMOS'14 detection benchmark, PCAD achieves state-of-the-art performance in high-speed models.
Keywords:
Temporal action detection
boundary proposal network
3D convolutional network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Multimedia Computing Communications and Applications cover
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
Papers:
2.0K
Citations:
5.4K

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.6K
Citations: 7.5K
S
shanghai polytechnic university
Scholars:
2.1K
Papers: 1.2K
Citations: 3
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Timekeeping in genetically programmed aging
err1993-03-01
err0
PREAI
errP.E. Kloeden; R. Rössler; O.E. Rössler
errShare
errSave
errShare
errSave
Phase-Field Modeling of Grain-Boundary Grooving Under Electromigration
err2016-08-16
err0
PREAI
errArnab Mukherjee; Kumar Ankit; Rajdip Mukherjee; Britta Nestler
errShare
errSave
Antibiotic-Sensitive TolC Mutants and Their Suppressors
err2004-03-15
err0
errOAAI
errAnne Marie Augustus; Teresa Celaya; Fasahath Husain; Matthew Humbard; Rajeev Misra
errShare
errSave
researcher View more