arrow
返回

PMBA: A Parallel MCMC Bayesian Computing Accelerator

delete2021-01-01
delete1
delete
OA
AI
Y
Yufei Ni
Y
Yangdong Deng *
S
Songlin Li
DOI:10.1109/ACCESS.2021.3076207delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Bayesian computing, including sampling probability distributions, learning graphic model, and Bayesian reasoning, is a powerful class of machine learning algorithms with such wide applications as biologic computing, financial analysis, natural language processing, autonomous driving, and robotics. The central pattern of Bayesian computing is the Markov Chain Monte Carlo (MCMC) computing, which is compute-intensive and lacks explicit parallelism. In this work, we propose a parallel MCMC Bayesian computing accelerator (PMBA) architecture. Designed as a probabilistic computing platform with native support for efficient single-chain parallel Metropolis-Hastings based MCMC sampling, PMBA boosts the performance of probabilistic programs with a massive-parallelism microarchitecture. PMBA is equipped with on-chip random number generators as the built-in source of randomness. The sampling units of PMBA are designed for parallel random sampling through a customized SIMD pipeline supporting data synchronization every iteration. A respective computing framework supporting automatic parallelization and mapping of probabilistic programs is also developed. Evaluation results demonstrate that PMBA enables a 17-21 folds speedup over a TITAN X GPU on MCMC sampling workload. On probabilistic benchmarks, PMBA outperforms prior best solutions by factor of 3.6 to 10.3. An exemplar based visual category learning algorithm is implemented on PMBA to demonstrate its efficiency and effectiveness for complex statistical learning problems.
Keyword:
Bayes methods
Probabilistic logic
Markov processes
Hardware
Synchronization
Computational modeling
Task analysis
Accelerator architectures
Bayesian methods
FPGA
MCMC
parallel machines
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Childhood leukaemia risks: from unexplained findings near nuclear installations to recommendations for future research
err2014-06-18
err0
errOAAI
errD Laurier; B Grosche; A Auvinen; J Clavel; C Cobaleda; A Dehos; S Hornhardt; S Jacob; P Kaatsch; O Kosti; C Kuehni; T Lightfoot; B Spycher; A Van Nieuwenhuyse; R Wakeford; G Ziegelberger
err分享
err收藏
Population-Based MCMC on Multi-Core CPUs, GPUs and FPGAs
err2016-04-01
err15
errOAAI
errMingas, Grigorios; Bouganis, Christos-Savvas
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
err分享
err收藏
学者 查看更多内容