返回
Latent semantic factorization for multimedia representation learning
DOI:10.1007/s11042-017-5135-6.png)
摘要
En 中文
Due to the rapid development of multimedia applications, cross-media semantics learning is becoming increasingly important nowadays. One of the most challenging issues for cross-media semantics understanding is how to mine semantic correlation between different modalities. Most traditional multimedia semantics analysis approaches are based on unimodal data cases and neglect the semantic consistency between different modalities. In this paper, we propose a novel multimedia representation learning framework via latent semantic factorization (LSF). First, the posterior probability under the learned classifiers is served as the latent semantic representation for different modalities. Moreover, we explore the semantic representation for a multimedia document, which consists of image and text, by latent semantic factorization. Besides, two projection matrices are learned to project images and text into a same semantic space which is more similar with the multimedia document. Experiments conducted on three real-world datasets for cross-media retrieval, demonstrate the effectiveness of our proposed approach, compared with state-of-the-art methods.
Keyword:
Posterior probability
Latent semantic factorization
Cross-modal retrieval
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
暂无机构信息
引用论文
Deep phenotyping of synovial molecular signatures by integrative systems analysis in rheumatoid arthritis通过类风湿关节炎的整合系统分析对滑膜分子特征进行深度表型分析
Rheumatology
IF0
Mining semantic correlation of heterogeneous multimedia data for cross-media retrieval面向跨媒体检索的异构多媒体数据语义关联挖掘

