arrow
返回

Unsupervised Deep Cross-modality Spectral Hashing

delete2020-01-01
delete21
delete
OA
AI
T
Tuan Hoang *
T
Thanh-Toan Do
T
Tam Nguyen
N
Ngai‐Man Cheung
DOI:10.1109/TIP.2020.3014727delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper presents a novel framework, namely Deep Cross-modality Spectral Hashing (DCSH), to tackle the unsupervised learning problem of binary hash codes for efficient cross-modal retrieval. The framework is a two-step hashing approach which decouples the optimization into (1) binary optimization and (2) hashing function learning. In the first step, we propose a novel spectral embedding-based algorithm to simultaneously learn single-modality and binary cross-modality representations. While the former is capable of well preserving the local structure of each modality, the latter reveals the hidden patterns from all modalities. In the second step, to learn mapping functions from informative data inputs (images and word embeddings) to binary codes obtained from the first step, we leverage the powerful CNN for images and propose a CNN-based deep architecture to learn text modality. Quantitative evaluations on three standard benchmark datasets demonstrate that the proposed DCSH method consistently outperforms other state-of-the-art methods.
Keyword:
Binary codes
Semantics
Optimization
Correlation
Sparse matrices
Task analysis
Training data
Cross-modal retrieval
spectral hashing
image search
constraint optimization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
University System of Ohio
学者数:
15.5W
论文数: 13.0W
被引数: 200
S
singapore university of technology & design
学者数:
2.8K
论文数: 3.6K
被引数: 5
U
University of Liverpool
学者数:
2.8W
论文数: 2.5W
被引数: 3.5W
学者 查看更多机构
引用论文

引用论文

The 1965 Eruption of Taal Volcano
err1966-02-25
err0
PREAI
errJames G. Moore; Kazuaki Nakamura; Arturo Alcaraz
err分享
err收藏
err分享
err收藏
Emerging trends and risk factors for perianal surgery in Crohn’s disease: a 20-year national population-based cohort study
err2016-08-01
err0
PREAI
errVivek Chhaya; Sonia Saxena; Elizabeth Cecil; Venkataraman Subramanian; Vasa Curcin; Azeem Majeed; Richard C. Pollok
err分享
err收藏
err分享
err收藏
Learning Discriminative Binary Codes for Large-scale Cross-modal Retrieval
err2017-05-01
err382
PREAI
errXu, Xing; Shen, Fumin; Yang, Yang; Shen, Heng Tao; Li, Xuelong
err分享
err收藏
The Role for Dickkopf-Homolog-1 in the Pathogenesis of Crohn’s Disease-Associated Fistulae
err2013-11-08
err0
errOAAI
errSandra Michaela Frei; Colette Hemsley; Theresa Pesch; Silvia Lang; Achim Weber; Ekkehard Jehle; Anne Rühl; Michael Fried; Gerhard Rogler; Michael Scharl
err分享
err收藏
A facile chemoselective deacetylation in the presence of benzoyl and p-bromobenzoyl groups using p-toluenesulfonic acid
err2001-04-01
err0
PREAI
errAntonio G González; Ignacio Brouard; Francisco León; Juan I Padrón; Jaime Bermejo
err分享
err收藏
学者 查看更多内容