返回
Large scale multi-output multi-class classification using Gaussian processes
DOI:10.1007/s10994-022-06289-3.png)
摘要
En 中文
Multi-output Gaussian processes (MOGPs) can help to improve predictive performance for some output variables, by leveraging the correlation with other output variables. In this paper, our main motivation is to use multiple-output Gaussian processes to exploit correlations between outputs where each output is a multi-class classification problem. MOGPs have been mostly used for multi-output regression. There are some existing works that use MOGPs for other types of outputs, e.g., multi-output binary classification. However, MOGPs for multi-class classification has been less studied. The reason is twofold: 1) when using a softmax function, it is not clear how to scale it beyond the case of a few outputs; 2) most common type of data in multi-class classification problems consists of image data, and MOGPs are not specifically designed to image data. We thus propose a new MOGPs model called Multi-output Gaussian Processes with Augment & Reduce (MOGPs-AR) that can deal with large scale classification and downsized image input data. Large scale classification is achieved by subsampling both training data sets and classes in each output whereas downsized image input data is handled by incorporating a convolutional kernel into the new model. We show empirically that our proposed model outperforms single-output Gaussian processes in terms of different performance metrics and multi-output Gaussian processes in terms of scalability, both in synthetic and in real classification problems. We include an example with the Ommiglot dataset where we showcase the properties of our model.
Keyword:
Gaussian processes
Multi-output Gaussian processes
Image data
Classification
Transfer learning
期刊
IF:
2.9
论文数:
2.7K
被引数:
3.4W
机构
引用论文
Stochastic variational hierarchical mixture of sparse Gaussian processes for regression
MACHINE LEARNING
IF2.9
Scalable Gaussian process-based transfer surrogates for hyperparameter optimization
MACHINE LEARNING
IF2.9
KaryoCreate: A CRISPR-based technology to study chromosome-specific aneuploidy by targeting human centromeresKaryoCreate: 一种基于CRISPR的技术,通过靶向人类着丝粒研究染色体特异性非整倍性
Cell
IF0

