.png){kind=icon}
返回
A multi-layer memory sharing network for video captioning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2022.109202.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Over the past several years, video captioning has received much attention in computer vision and ma-chine learning communities. Many models utilize an RNN-based decoder to generate sentences describing the content of a video. They have achieved much progress; however, few methods adopt a decoder with more than three layers because an RNN-based model with more layers may become hard to train, time-consuming or even deteriorate at a certain depth. To address the limitation, we propose a Multi-layer memory sharing Network, MesNet for short, which allows more layers to be stacked without compro-mising performance. In MesNet, we construct a novel memory sharing structure to strengthen the con-nections between layers and make the model easier to train. More specifically, we design an Enhanced Gated Recurrent Unit (En-GRU) and stack it to construct a deeper network. Unlike traditional RNN-based multi-layer networks, the memory states of all layers in MesNet are cross-used at each iteration to mimic the brain's complex connections. Extensive experiments on MSVD and MSR-VTT demonstrate that our method performs well and outperforms some state-of-the-art methods significantly. Our code is available at https://github.com/nbbb/MesNet .(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Video captioning
Multi -layer network
Memory sharing
Enhanced gated recurrent unit
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
分享收藏分享收藏GR-RNN: Global-context residual recurrent neural networks for writer identification.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏SARS due to COVID-19: Predictors of death and profile of adult patients in the state of Rio de Janeiro, 2020PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏Enhancing the alignment between target words and corresponding frames for video captioningPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Optimized Deep Stacked Long Short-Term Memory Network for Long-Term Load Forecasting用于长期负荷预测的优化深度堆叠长短期记忆网络IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏
查看更多内容