arrow
返回

Large scale multi-output multi-class classification using Gaussian processes

delete2023-02-08
delete3
delete
OA
AI
C
Chunchao Ma *
M
Mauricio A. Álvarez
DOI:10.1007/s10994-022-06289-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-output Gaussian processes (MOGPs) can help to improve predictive performance for some output variables, by leveraging the correlation with other output variables. In this paper, our main motivation is to use multiple-output Gaussian processes to exploit correlations between outputs where each output is a multi-class classification problem. MOGPs have been mostly used for multi-output regression. There are some existing works that use MOGPs for other types of outputs, e.g., multi-output binary classification. However, MOGPs for multi-class classification has been less studied. The reason is twofold: 1) when using a softmax function, it is not clear how to scale it beyond the case of a few outputs; 2) most common type of data in multi-class classification problems consists of image data, and MOGPs are not specifically designed to image data. We thus propose a new MOGPs model called Multi-output Gaussian Processes with Augment & Reduce (MOGPs-AR) that can deal with large scale classification and downsized image input data. Large scale classification is achieved by subsampling both training data sets and classes in each output whereas downsized image input data is handled by incorporating a convolutional kernel into the new model. We show empirically that our proposed model outperforms single-output Gaussian processes in terms of different performance metrics and multi-output Gaussian processes in terms of scalability, both in synthetic and in real classification problems. We include an example with the Ommiglot dataset where we showcase the properties of our model.
Keyword:
Gaussian processes
Multi-output Gaussian processes
Image data
Classification
Transfer learning

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

U
University of Sheffield
学者数:
3.0W
论文数: 2.9W
被引数: 3.9W
U
University of Manchester
学者数:
5.7W
论文数: 5.3W
被引数: 7.4W
引用论文

引用论文

Large scale multi-label learning using Gaussian processes
err2021-04-14
err5
errOAAI
errPanos, Aristeidis; Dellaportas, Petros; Titsias, Michalis K.
err分享
err收藏
Stochastic variational hierarchical mixture of sparse Gaussian processes for regression
err2018-07-06
err4
errOAAI
errThi Nhat Anh Nguyen; Bouzerdoum, Abdesselam; Son Lam Phung
err分享
err收藏
err2001-01-01
err0
PREAI
errStefan T. Perisanu
err分享
err收藏
Scalable Gaussian process-based transfer surrogates for hyperparameter optimization
err2017-12-22
err59
errOAAI
errWistuba, Martin; Schilling, Nicolas; Schmidt-Thieme, Lars
err分享
err收藏
err分享
err收藏
Polypharmacy and the risk of drug–drug interactions and potentially inappropriate medications in hospital psychiatry
err2021-06-24
err0
errOAAI
errJan Wolff; Gudrun Hefner; Claus Normann; Klaus Kaier; Harald Binder; Christoph Hiemke; Sermin Toto; Katharina Domschke; Michael Marschollek; Ansgar Klimke
err分享
err收藏
KaryoCreate: A CRISPR-based technology to study chromosome-specific aneuploidy by targeting human centromeresKaryoCreate: 一种基于CRISPR的技术,通过靶向人类着丝粒研究染色体特异性非整倍性
errCell
IF0
err2023-04-01
err0
errOAAI
errNazario Bosco; Aleah Goldberg; Xin Zhao; Joseph C. Mays; Pan Cheng; Adam F. Johnson; Joy J. Bianchi; Cecilia Toscani; Elena Di Tommaso; Lizabeth Katsnelson; Dania Annuar; Sally Mei; Roni E. Faitelson; Ilan Y. Pesselev; Kareem S. Mohamed; Angela Mermerian; Elaine M. Camacho-Hernandez; Courtney A. Gionco; Julie Manikas; Yi-Shuan Tseng; Zhengxi Sun; Somayeh Fani; Sarah Keegan; Scott M. Lippman; David Fenyö; Simona Giunta; Stefano Santaguida; Teresa Davoli
err分享
err收藏
学者 查看更多内容