arrow
返回

Binary Set Embedding for Cross-Modal Retrieval

delete2017-12-01
delete20
delete
OA
AI
M
Mengyang Yu
刘
刘丽 (Li Liu)
Ling Shao 封面图
Ling Shao (Ling Shao) *
DOI:10.1109/TNNLS.2016.2609463delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Cross-modal retrieval is such a challenging topic that traditional global representations would fail to bridge the semantic gap between images and texts to a satisfactory level. Using local features from images and words from documents directly can be more robust for the scenario with large intraclass variations and small interclass discrepancies. In this paper, we propose a novel unsupervised binary coding algorithm called binary set embedding (BSE) to obtain meaningful hash codes for local features from the image domain and words from text domain. Understanding image features with the word vectors learned from the human language instead of the provided documents from data sets, BSE can map samples into a common Hamming space effectively and efficiently where each sample is represented by the sets of local feature descriptors from image and text domains. In particular, BSE explores relationship among local features in both feature level and image (text) level, which can balance the sensitivity of each other. Furthermore, a recursive orthogonalization procedure is applied to reduce the redundancy of codes. Extensive experiments demonstrate the superior performance of BSE compared with state-of-the-art cross-modal hashing methods using either image or text queries.
Keyword:
Cross-modal retrieval
hashing
local descriptor
multimedia
word vector
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

S
southwest university - china
学者数:
2.6W
论文数: 1.9W
被引数: 21
N
Northumbria University
学者数:
5.6K
论文数: 6.8K
被引数: 9.5K
引用论文

引用论文

Slippery Business
err2004-01-01
err0
PREAI
errMichael J. Lynch; Paul B. Stretesky; Ronald G. Burns
err分享
err收藏
err分享
err收藏
Semantic hashing
err2009-07-01
err939
errOAAI
errSalakhutdinov, Ruslan; Hinton, Geoffrey
err分享
err收藏
学者 查看更多内容