返回
Action detection and classification in kitchen activities videos using graph decoding
DOI:10.1007/s00371-021-02346-5.png)
摘要
En 中文
In this work, we propose a hybrid deep network/graph decoding using hidden Markov model system for the classification of kitchen activities for the Actions for Cooking Eggs data set. We use and compare two deep learning architectures, a deep convolutional neural network (CNN) alone and a long short-term memory network built on top of a CNN. We address the video classification problem both on the level of actions performed in certain frames and the full-length video level. Our proposed system detects a sequence of cooking actions and outputs a menu class for the entire video. Our approach achieves the highest reported accuracy on the data set for identifying cooking actions with an overall accuracy of 81% compared to the state of the art of 76% and succeeds in assigning a menu label to a sequence of cooking actions with an accuracy of 100% compared to an accuracy range of 10-30% reported in previous work. We also explore the effects of processing a subset of the available frames and imposing a state occupancy constraint during decoding. Our best reported results are achieved when using a common-sense dictionary grammar expansion when processing one frame out of every 35 frames and when restricting state transitions for at least five consecutive frames.
Keyword:
Video classification
Action detection
Graph decoding
Two-level classification
期刊
IF:
2.9
论文数:
4.6K
被引数:
6.5K
机构
引用论文
A TUTORIAL ON HIDDEN MARKOV-MODELS AND SELECTED APPLICATIONS IN SPEECH RECOGNITION关于语音识别中的隐马尔可夫模型和选定应用的教程
PROCEEDINGS OF THE IEEE
IF25.9
Gender Differences in Physical Activity and Health-Related Authorships Between 1950 and 20191950年至2019年间体力活动与健康相关著作中的性别差异
Exposure to arsenic, polycyclic aromatic hydrocarbons, metals, and association with skin cancers in the US adults接触砷、多环芳烃、金属与美国人皮肤癌的关联

