arrow
返回

Self-Supervised Video Hashing With Hierarchical Binary Auto-Encoder

delete2018-07-01
delete195
delete
OA
AI
Jingkuan Song 封面图
Jingkuan Song (Jingkuan Song)
H
Hanwang Zhang *
X
Xiangpeng Li
L
Lianli Gao *
王
王萌 (Meng Wang)
R
Richang Hong
DOI:10.1109/TIP.2018.2814344delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Existing video hash functions are built on three isolated stages: frame pooling, relaxed learning, and binarization, which have not adequately explored the temporal order of video frames in a joint binary optimization model, resulting in severe information loss. In this paper, we propose a novel unsupervised video hashing framework dubbed self-supervised video hashing (SSVH), which is able to capture the temporal nature of videos in an end-to-end learning to hash fashion. We specifically address two central problems: 1) how to design an encoder-decoder architecture to generate binary codes for videos and 2) how to equip the binary codes with the ability of accurate video retrieval. We design a hierarchical binary auto-encoder to model the temporal dependencies in videos with multiple granularities, and embed the videos into binary codes with less computations than the stacked architecture. Then, we encourage the binary codes to simultaneously reconstruct the visual content and neighborhood structure of the videos. Experiments on two real-world data sets show that our SSVH method can significantly outperform the state-of-the-art methods and achieve the current best performance on the task of unsupervised video retrieval.
Keyword:
Video hashing
video retrieval
self-supervised
binary LSTM
neighbor model
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

The 1965 Eruption of Taal Volcano
err1966-02-25
err0
PREAI
errJames G. Moore; Kazuaki Nakamura; Arturo Alcaraz
err分享
err收藏
Drying Processes Assisted by PEF for Plant-Based Materials
err2021-01-01
err0
PREAI
errArtur Wiktor; Alica Lammerskitten; Francisco Barba; Martin Michalski; Stefan Toepfl; Oleksii Parniakov
err分享
err收藏
err分享
err收藏
err分享
err收藏
Distributed Adaptive Binary Quantization for Fast Nearest Neighbor Search
err2017-11-01
err64
PREAI
errLiu, Xianglong; Li, Zhujin; Deng, Cheng; Tao, Dacheng
err分享
err收藏
学者 查看更多内容