arrow
Return

Learning deep spatiotemporal features for video captioning

delete2018-12-01
delete11
PRE
AI
E
Eleftherios Daskalakis
M
Maria Tzelepi *
A
Anastasios Tefas
DOI:10.1016/j.patrec.2018.09.022delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a novel automatic video captioning system which translates videos to sentences, utilizing a deep neural network that is composed of three building parts of convolutional and recurrent structure. That is, the first subnetwork operates as feature extractor of single frames. The second subnetwork is a three-stream network, capable of capturing spatial semantic information in the first stream, temporal semantic information in the second stream, and global video concept information in the third stream. The third subnetwork generates relevant textual captions using as input the spatiotemporal features of the second subnetwork. The experimental validation indicates the effectiveness of the proposed model, achieving superior performance over competitive methods. (C) 2018 Elsevier B.V. All rights reserved.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
8.0K
Citations:
1.6W

Organization

A
aristotle university of thessaloniki
Scholars:
2.6W
Papers: 2.0W
Citations: 19
Cited Papers

Cited Papers

ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
A region-based image caption generator with refined descriptions
err2018-01-01
err76
errOAAI
errKinghorn, Philip; Zhang, Li; Shao, Ling
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave