.png){kind=icon}
返回
Cross-Modal Retrieval Using Multiordered Discriminative Structured Subspace Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2016.2646219.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper proposes a novel method for cross-modal retrieval. In addition to the traditional vector (text)-to-vector (image) framework, we adopt a matrix (text)-to-matrix (image) framework to faithfully characterize the structures of different feature spaces. Moreover, we propose a novel metric learning framework to learn a discriminative structured subspace, in which the underlying data distribution is preserved for ensuring a desirablemetric. Concretely, there are three steps for the proposed method. First, the multiorder statistics are used to represent images and texts for enriching the feature information. We jointly use the covariance (second-order), mean (first-order), and bags of visual (textual) features (zeroth-order) to characterize each image and text. Second, considering that the heterogeneous covariance matrices lie on the different Riemannian manifolds and the other features on the different Euclidean spaces, respectively, we propose a unified metric learning framework integrating multiple distance metrics, one for each order statistical feature. This framework preserves the underlying data distribution and exploits complementary information for better matching heterogeneous data. Finally, the similarity between the different modalities can be measured by transforming the multiorder statistical features to the common subspace. The performance of the proposed method over the previous methods has been demonstrated through the experiments on two public datasets.
Keyword:
Cross-modal retrieval
documents and images
multimedia
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
引用论文
Solution Structure of Monomeric Peptide YY Supports the Functional Significance of the PP-Fold,.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏
Deep phenotyping of synovial molecular signatures by integrative systems analysis in rheumatoid arthritis通过类风湿关节炎的整合系统分析对滑膜分子特征进行深度表型分析Rheumatology
RheumatologyIF0
PREAI
分享收藏Mining semantic correlation of heterogeneous multimedia data for cross-media retrieval面向跨媒体检索的异构多媒体数据语义关联挖掘
PREAI
分享收藏
查看更多内容