arrow
返回

Bridge-NDP: Efficient Communication-Computation Overlap in Near Data Processing System

delete2025-01-01
delete0
PRE
AI
L
Liyan Chen
P
Pengyu Liu
D
Dongxu Lyu
蒋剑飞 (Jianfei Jiang)
Q
Qin Wang
Z
Zhigang Mao
N
Naifeng Jing
DOI:10.1109/TCAD.2025.3531254delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
近数据处理(NDP),通过基于DIMM的主内存中的近数据加速器(NDAs)实现,通过提供更大的聚合带宽和减少长距离数据传输来提升性能。尽管NDAs的性能已受到广泛关注,但主机-NDAs通信的开销却被忽视,成为NDP系统中的瓶颈。为缓解通信导致的性能下降,我们提出了Bridge-NDP,这是首个实现通信-计算高效重叠的NDP架构。Bridge-NDP建立在传统NDP架构之上,可轻松应用于现有NDP设计,无论NDAs连接在哪个内存层级。具体而言,我们引入了一种新颖的直接主机-NDAs通信方法,利用现有内存总线作为桥接总线,避免了新增互连的需求。它能够在与其他内存访问无缝集成的同时,以最小的硬件开销实现高带宽利用率。在系统级工作流设计中,我们优化并扩展现有数据流,以实现更丰富的计算范式并减少冗余内存访问。此外,我们通过高效的API设计和数据管理提供编程支持,隐藏底层资源细节并确保正确性保证。全面的实验表明,Bridge-NDP实现了显著性能提升,相比当前最先进的NDP方案,加速比达到1.8倍至3.1倍,带宽利用率提升2.0倍至2.9倍。
Keyword:
Bridge buses
near data processing (NDP)
overlap
workflow

期刊

I
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
IF:
2.9
论文数:
606
被引数:
9.6K

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

DRAMsim3: A Cycle-Accurate, Thermal-Capable DRAM Simulator
err2020-07-01
err0
errOAAI
errShang Li; Zhiyuan Yang; Dhiraj Reddy; Ankur Srivastava; Bruce Jacob
err分享
err收藏
System Architecture and Software Stack for GDDR6-AiM
err2022-08-21
err0
PREAI
errYongkee Kwon; Kornijcuk Vladimir; Nahsung Kim; Woojae Shin; Jongsoon Won; Minkyu Lee; Hyunha Joo; Haerang Choi; Guhyun Kim; Byeongju An; Jeongbin Kim; Jaewook Lee; Ilkon Kim; Jaehan Park; Chanwook Park; Yosub Song; Byeongsu Yang; Hyungdeok Lee; Seho Kim; Daehan Kwon; Seongju Lee; Kyuyoung Kim; Sanghoon Oh; Joonhong Park; Gimoon Hong; Dongyoon Ka; Kyudong Hwang; Jeongje Park; Kyeongpil Kang; Jungyeon Kim; Junyeol Jeon; Myeongjun Lee; Minyoung Shin; Minhwan Shin; Jaekyung Cha; Changson Jung; Kijoon Chang; Chunseok Jeong; Euicheol Lim; Il Park; Junhyun Chun; Sk Hynix
err分享
err收藏
MeNDA
err2022-06-11
err0
PREAI
errSiying Feng; Xin He; Kuan-Yu Chen; Liu Ke; Xuan Zhang; David Blaauw; Trevor Mudge; Ronald Dreslinski
err分享
err收藏
NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing
err2024-04-27
err0
errOAAI
errGuseul Heo; Sangyeop Lee; Jaehong Cho; Hyunmin Choi; Sanghyeon Lee; Hyungkyu Ham; Gwangsun Kim; Divya Mahajan; Jongse Park
err分享
err收藏
DIMMining
err2022-06-11
err0
errOAAI
errGuohao Dai; Zhenhua Zhu; Tianyu Fu; Chiyue Wei; Bangyan Wang; Xiangyu Li; Yuan Xie; Huazhong Yang; Yu Wang
err分享
err收藏
PIMSim: A Flexible and Detailed Processing-in-Memory Simulator
err2019-01-01
err0
PREAI
errSheng Xu; Xiaoming Chen; Ying Wang; Yinhe Han; Xuehai Qian; Xiaowei Li
err分享
err收藏
学者 查看更多内容