.png){kind=icon}
Return
Cross-Modal Retrieval Using Multiordered Discriminative Structured Subspace Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2016.2646219.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This paper proposes a novel method for cross-modal retrieval. In addition to the traditional vector (text)-to-vector (image) framework, we adopt a matrix (text)-to-matrix (image) framework to faithfully characterize the structures of different feature spaces. Moreover, we propose a novel metric learning framework to learn a discriminative structured subspace, in which the underlying data distribution is preserved for ensuring a desirablemetric. Concretely, there are three steps for the proposed method. First, the multiorder statistics are used to represent images and texts for enriching the feature information. We jointly use the covariance (second-order), mean (first-order), and bags of visual (textual) features (zeroth-order) to characterize each image and text. Second, considering that the heterogeneous covariance matrices lie on the different Riemannian manifolds and the other features on the different Euclidean spaces, respectively, we propose a unified metric learning framework integrating multiple distance metrics, one for each order statistical feature. This framework preserves the underlying data distribution and exploits complementary information for better matching heterogeneous data. Finally, the similarity between the different modalities can be measured by transforming the multiorder statistical features to the common subspace. The performance of the proposed method over the previous methods has been demonstrated through the experiments on two public datasets.
Keywords:
Cross-modal retrieval
documents and images
multimedia
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
9.7
Papers:
4.5K
Citations:
2.4W
Organization
Cited Papers
Solution Structure of Monomeric Peptide YY Supports the Functional Significance of the PP-Fold,.png)
Biochemistry
BiochemistryIF0
PREAI
ShareSave
Deep phenotyping of synovial molecular signatures by integrative systems analysis in rheumatoid arthritisRheumatology
RheumatologyIF0
PREAI
ShareSaveShareSaveShareSaveShareSaveShareSaveShareSave
View more