.png){kind=icon}
返回
Distributed Gaussian Processes Hyperparameter Optimization for Big Data Using Proximal ADMM
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2019.2925532.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Hyperparameter optimization still remains the core issue in Gaussian processes (GPs) for machine learning. The classical hyperparameter optimization scheme based on maximum likelihood estimation is impractical for big data processing, as its computational complexity is cubic in terms of the number of data points. With the rapid development of efficient parallel data processing on ever cheaper and more powerful hardware, distributed models and algorithms will become ubiquitous. In this letter, we propose an alternative distributed GP hyperparameter optimization scheme using the efficient proximal alternating direction method of multipliers, proposed by Hong et al. in 2016, and we derive the closed-form solution for the local sub-problems. In contrast to the existing schemes of similar kind, our proposed one well balances the computational load on each local machine and the communication overhead required for global consensus of the local hyperparameter estimates. The proposed scheme can work in either a synchronous or an asynchronous manner, thus very flexible to be adopted in different computing facilities. Experimental results with both synthetic and real datasets validate the outstanding performance of the proposed scheme.
Keyword:
ADMM
big data
distributed algorithm
Gaussian processes
hyperparameter optimization
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
查看更多机构
引用论文
Recent Progress in Sensor Arrays: From Construction Principles of Sensing Elements to Applications传感器阵列的最新进展: 从传感元件的构造原理到应用.png)
ACS Sensors
ACS SensorsIF0
PREAI
分享收藏Wireless Traffic Prediction With Scalable Gaussian Process: Framework, Algorithms, and Verification
OAAI
OAAI分享收藏 没有更多内容