arrow
返回

Computing En-Route for Near-Data Processing

delete2021-06-01
delete4
PRE
AI
J
Jiayi Huang *
P
Pritam Majumder
S
Sungkeun Kim
T
Troy Fulton
R
Ramprakash Reddy Puli
K
Ki Hwan Yum
E
Eun Jung Kim
DOI:10.1109/TC.2021.3063378delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The data explosion and faster data analysis demand have spawned emerging applications that operate over myriads of data and exhibit large memory footprints with low data reuse rate. Such characteristics lead to enormous data movements across the memory hierarchy and pose significant pressure on modern communication fabrics and memory subsystems. To mitigate the worsening gap between high processor computation density and deficient memory bandwidth, memory networks, and near-data processing techniques are proposed to keep improving system performance and energy efficiency. In this article, we propose Active-Routing, an in-network near-data processing architecture for data-flow execution, which enables computation en-route by exploiting patterns of aggregation over intermediate results. The proposed architecture leverages the massive memory cube- and vault-level parallelism as well as network concurrency to optimize the aggregation operations along a dynamically built Active-Routing Tree. It also introduces page granular computation offloading to amortize the offloading overhead and improve the throughput. Compared to the state-of-the-art processing-in-memory architecture, the evaluations show that the baseline Active-Routing can achieve up to 7x speedup with an average of 60 percent performance improvement, and reduce the energy-delay product by 80 percent across various benchmarks. Further optimizations with vault-level parallelism and page granular offloading can achieve an extra order of magnitude improvement.
Keyword:
Bandwidth
Parallel processing
Kernel
Optimization
Random access memory
Memory management
Fabrics
Memory network
data-flow
in-network computing
near-data processing
processing-in-memory
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.3K
被引数:
9.8K

机构

U
University of California Santa Barbara
学者数:
1.2W
论文数: 9.6K
被引数: 3.6W
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
T
Texas A&M University System
学者数:
4.4W
论文数: 4.0W
被引数: 4.0K
学者 查看更多机构
引用论文

引用论文

Management of Chronic Visceral Pain
err2016-06-03
err0
PREAI
errAnne E Olesen; Adam D Farmer; S⊘ren S Olesen; Qasim Aziz; Asbj⊘rn M Drewes
err分享
err收藏
GoogleWorkloads for Consumer Devices: Mitigating Data Movement Bottlenecks
err2018-03-19
err189
PREAI
errBoroumand, Amirali; Ghose, Saugata; Kim, Youngsok; Ausavarungnirun, Rachata; Shiu, Eric; Thakur, Rahul; Kim, Daehyun; Kuusela, Aki; Knies, Allan; Ranganathan, Parthasarathy; Mutlu, Onur
err分享
err收藏
Surrogate Technologies for Monitoring Bed‐Load Transport in Rivers
err2010-04-16
err0
PREAI
errJohn R. Gray; Jeffrey W. Gartner; Jonathan S. Barton; Janet Gaskin; Smokey A. Pittman; Colin D. Rennie
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
err分享
err收藏
Periconceptional undernutrition in sheep leads to decreased locomotor activity in a natural environment
err2013-05-31
err0
PREAI
errE. L. Donovan; C. E. Hernandez; L. R. Matthews; M. H. Oliver; A. L. Jaquiery; F. H. Bloomfield; J. E. Harding
err分享
err收藏
学者 查看更多内容