arrow
返回

Hierarchically Supervised Deconvolutional Network for Semantic Video Segmentation

delete2017-04-01
delete31
PRE
AI
Y
Yuhang Wang
刘
刘静 (Jing Liu) *
李勇 封面图
李勇 (Yong Li)
J
Jun Fu
M
Min Xu
卢
卢汉清 (Hanqing Lu)
DOI:10.1016/j.patcog.2016.09.046delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Semantic video segmentation is a challenging task of fine-grained semantic understanding of video data. In this paper, we present a jointly trained deep learning framework to make the best use of spatial and temporal information for semantic video segmentation. Along the spatial dimension, a hierarchically supervised deconvolutional neural network (HDCNN) is proposed to conduct pixel-wise semantic interpretation for single video frames. HDCNN is constructed with convolutional layers in VGG-net and their mirrored deconvolutional structure, where all fully connected layers are removed. And hierarchical classification layers are added to multi scale deconvolutional features to introduce more contextual information for pixel-wise semantic interpretation. Besides, a coarse-to-fine training strategy is adopted to enhance the performance of foreground object segmentation in videos. Along the temporal dimension, we introduce Transition Layers upon the structure of HDCNN to make the pixel-wise label prediction consist with adjacent, pixels across space and time domains. The learning process of the Transition Layers can be implemented as a set of extra convolutional calculations connected with HDCNN. These two parts are jointly trained as a unified deep network in our approach. Thorough evaluations are performed on two challenging video datasets, i.e., CamVid and GATECH. Our approach achieves state-of-the-art performance on both of the two datasets.
Keyword:
Semantic video segmentation
Deconvolutional neural network
Coarse-to-fine training
Spatio-temporal consistence
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Superparsing
err2012-10-06
err128
PREAI
errTighe, Joseph; Lazebnik, Svetlana
err分享
err收藏
err分享
err收藏
Catalytic Mechanism of C–C Hydrolase MhpC from Escherichia coli: Kinetic Analysis of His263 and Ser110 Site-directed Mutants
err2005-02-01
err0
PREAI
errChen Li; Mark G. Montgomery; Fiyaz Mohammed; Jian-Jun Li; Stephen P. Wood; Timothy D.H. Bugg
err分享
err收藏
学者 查看更多内容