arrow
返回

Action detection and classification in kitchen activities videos using graph decoding

delete2022-01-10
delete2
PRE
AI
M
Mona Ramadan *
A
A. El-Jaroudi
DOI:10.1007/s00371-021-02346-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this work, we propose a hybrid deep network/graph decoding using hidden Markov model system for the classification of kitchen activities for the Actions for Cooking Eggs data set. We use and compare two deep learning architectures, a deep convolutional neural network (CNN) alone and a long short-term memory network built on top of a CNN. We address the video classification problem both on the level of actions performed in certain frames and the full-length video level. Our proposed system detects a sequence of cooking actions and outputs a menu class for the entire video. Our approach achieves the highest reported accuracy on the data set for identifying cooking actions with an overall accuracy of 81% compared to the state of the art of 76% and succeeds in assigning a menu label to a sequence of cooking actions with an accuracy of 100% compared to an accuracy range of 10-30% reported in previous work. We also explore the effects of processing a subset of the available frames and imposing a state occupancy constraint during decoding. Our best reported results are achieved when using a common-sense dictionary grammar expansion when processing one frame out of every 35 frames and when restricting state transitions for at least five consecutive frames.
Keyword:
Video classification
Action detection
Graph decoding
Two-level classification

期刊

Visual Computer 封面图
Visual Computer
IF:
2.9
论文数:
4.6K
被引数:
6.5K

机构

P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
引用论文

引用论文

err分享
err收藏
Gender Differences in Physical Activity and Health-Related Authorships Between 1950 and 20191950年至2019年间体力活动与健康相关著作中的性别差异
err2024-05-01
err0
errOAAI
errEduardo Ribes Kohn; Pedro Curi Hallal; Gloria Isabel Niño-Cruz; Julia Almentero; Diana Pinzón; Maristela Böhlke; Katja Siefken; Michael Pratt; Andrea Ramirez-Varela
err分享
err收藏
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
Multiple Granularity Modeling: A Coarse-to-Fine Framework for Fine-grained Action Analysis
err2016-03-01
err9
PREAI
errNi, Bingbing; Paramathayalan, Vignesh R.; Li, Teng; Moulin, Pierre
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容