返回
Combining information theoretic kernels with generative embeddings for classification
DOI:10.1016/j.neucom.2012.08.014.png)
摘要
En 中文
Classical approaches to learn classifiers for structured objects (e.g., images, sequences) use generative models in a standard Bayesian framework. To exploit the state-of-the-art performance of discriminative learning, while also taking advantage of generative models of the data, generative embeddings have been recently proposed as a way of building hybrid discriminative/generative approaches. A generative embedding is a mapping, induced by a generative model (usually learned from data), from the object space into a fixed dimensional space, adequate for discriminative classifier learning. Generative embeddings have been shown to often outperform the classifiers obtained directly from the generative models upon which they are built. Using a generative embedding for classification involves two main steps: (i) defining and learning a generative model and using it to build the embedding: (ii) discriminatively learning a (maybe kernel) classifier with the embedded data. The literature on generative embeddings is essentially focused on step (i), usually taking some standard off-the-shelf tool for step (ii). Here, we adopt a different approach, by focusing also on the discriminative learning step. In particular, we exploit the probabilistic nature of generative embeddings, by using kernels defined on probability measures; in particular we investigate the use of a recent family of non-extensive information theoretic kernels on the top of different generative embeddings. We show, in different medical applications that the approach yields state-of-the-art performance. (C) 2012 Elsevier B.V. All rights reserved.
Keyword:
Hybrid generative-discriminative schemes
Generative embeddings
Probabilistic latent semantic analysis
Information theoretic kernels
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
A review of the Irish crustal structure and signatures from the Caledonian and Variscan Orogenies
Terra Nova
IF0
Unsupervised learning by probabilistic latent semantic analysis基于概率潜在语义分析的无监督学习
MACHINE LEARNING
IF2.9
Sea Anemone Genome Reveals Ancestral Eumetazoan Gene Repertoire and Genomic Organization海王星基因组揭示了祖先的Eumetazoan基因库和基因组组织
Science
IF0

