返回
Topic driven multimodal similarity learning with multi-view voted convolutional features
DOI:10.1016/j.patcog.2017.02.035.png)
摘要
En 中文
Similarity (and distance metric) learning plays a very important role in many artificial intelligence tasks aiming at quantifying the relevance between objects. We address the challenge of learning complex relation patterns from data objects exhibiting heterogeneous properties, and develop an effective multi view multimodal similarity learning model with much improved learning performance and model interpretability. The proposed method firstly computes multi-view convolutional features to achieve improved object representation, then analyses the similarities between objects by operating over multiple hidden relation types (modalities), and finally fine-tunes the entire model variables via back -propagating a ranking loss to the convolutional layers. We develop a topic-driven initialization scheme, so that each learned relation type can be interpreted as a representative of semantic topics of the objects. To improve model interpretability and generalization, sparsity is imposed over these hidden relations. The proposed method is evaluated by solving the image retrieval task using challenging image datasets, and is compared with seven state-of-the-art algorithms in the field. Experimental results demonstrate significant performance improvement of the proposed method over the competing ones. (C) 2017 Elsevier Ltd. All rights reserved.
Keyword:
Convolutional auto-encoder
Representation learning
Multi-view learning
Multimodal similarity learning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Solution Structure of Monomeric Peptide YY Supports the Functional Significance of the PP-Fold,
Biochemistry
IF0
SIFT: predicting amino acid changes that affect protein functionSIFT: 预测影响蛋白质功能的氨基酸变化
NUCLEIC ACIDS RESEARCH
IF13.1
Improved Particle Size Control for the Dispersion Polymerization of Methyl methacrylate in Supercritical Carbon Dioxide超临界二氧化碳中甲基丙烯酸甲酯分散聚合的改进粒度控制
String representations and distances in deep Convolutional Neural Networks for image classification
PATTERN RECOGNITION
IF7.6

