arrow
返回

MrPhi: An Optimized MapReduce Framework on Intel Xeon Phi Coprocessors

delete2015-11-01
delete19
PRE
AI
M
Mian Lu *
Y
Yun Liang
Bingsheng He 封面图
Bingsheng He (Bingsheng He)
R
Rick Siow Mong Goh
DOI:10.1109/TPDS.2014.2365784delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this work, we develop MrPhi, an optimized MapReduce framework on a heterogeneous computing platform, particularly equipped with multiple Intel Xeon Phi coprocessors. To the best of our knowledge, this is the first work to optimize the MapReduce framework on the Xeon Phi. We first focus on employing advanced features of the Xeon Phi to achieve high performance on a single coprocessor. We propose a vectorization friendly technique and SIMD hash computation algorithms to utilize the SIMD vectors. Then we pipeline the map and reduce phases to improve the resource utilization. Furthermore, we eliminate multiple local arrays but use low cost atomic operations on the global array to improve the thread scalability. For a given application, our framework is able to automatically detect suitable techniques to apply. Moreover, we extend our framework to a heterogeneous platform to utilize all hardware resource effectively. We adopt non-blocking data transfer to hide the communication overhead. We also adopt aligned memory transfer in order to fully utilize the PCIe bandwidth between the host and coprocessor. We conduct comprehensive experiments to benchmark the Xeon Phi and compare our optimized MapReduce framework with a state-of-the-art multi-core based MapReduce framework (Phoenix++). By evaluating six real-world applications, the experimental results show that our optimized framework is 1.2 to 38 x faster than Phoenix++ for various applications on a single Xeon Phi. Additionally, the performance of four applications is able to achieve linear scalability on a platform equipped with up to four Xeon Phi coprocessors.
Keyword:
Xeon Phi
Intel Many Integrated Core architecture (MIC)
coprocessors
MapReduce
parallel programming
high performance computing
heterogeneous computing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

A
a*star - institute of high performance computing (ihpc)
学者数:
1.5K
论文数: 1.3K
被引数: 3
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Novel missense mutations in MYO7A underlying postlingual high- or low-frequency non-syndromic hearing impairment in two large families from China
err2010-12-09
err0
errOAAI
errYi Sun; Jing Chen; Hanjun Sun; Jing Cheng; Jianzhong Li; Yu Lu; Yanping Lu; Zhanguo Jin; Yuhua Zhu; Xiaomei Ouyang; Denise Yan; Pu Dai; Dongyi Han; Weiyan Yang; Rongguang Wang; Xuezhong Liu; Huijun Yuan
err分享
err收藏
The effect of substitution of a thioether donor by a phosphine donor in thiacrown complexes of iron
err2002-10-01
err0
PREAI
errFrank E. Sowrey; Philip J. Blower; John C. Jeffery; Elizabeth J. MacLean; Michael J. Went
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容