arrow
Return

A Data-Driven Dynamic Execution Orchestration Architecture

delete2026-01-01
delete0
PRE
AI
Z
Zhenyu Bai
P
Pranav Dangi
R
Rohan Juneja
李昭莹 cover
李昭莹 (Zhaoying Li) *
Z
Zhanglu Yan
H
Huiying Lan
T
Tulika Mitra
DOI:10.1145/3760250.3762226delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Domain-specific accelerators deliver exceptional performance on their target workloads through fabrication-time orchestrated datapaths. However, such specialized architectures often exhibit performance fragility when exposed to new kernels or irregular input patterns. In contrast, programmable architectures like FPGAs, CGRAs, and GPUs rely on compiletime orchestration to support a broader range of applications; but they are typically less efficient under irregular or sparse data. Pushing the boundaries of programmable architectures requires designs that can achieve efficiency and high-performance on par with specialized accelerators while retaining the agility of general-purpose architectures. We introduce Canon, a parallel architecture that bridges the gap between specialized and general purpose architectures. Canon exploits data-level and instruction-level parallelism through its novel design. First, it employs a novel dynamic data-driven orchestration mechanism using programmable Finite State Machines (FSMs). These FSMs are programmed at compile time to encode high-level dataflow per state and translate incoming meta-information (e.g., sparse coordinates) into control instructions at runtime. Second, Canon introduces a time-lapsed SIMD execution in which instructions are issued across a row of processing elements over several cycles, creating a staggered pipelined execution. These innovations amortize control overhead, allowing dynamic instruction changes while constructing a continuously evolving dataflow that maximizes parallelism. Experimental evaluation shows that Canon delivers high performance across diverse data-agnostic and data-driven kernels while achieving efficiency comparable to specialized accelerators, yet retaining the flexibility of a general-purpose architecture.
Keywords:
Dataflow Architectures
Sparse Accelerators

Journal

P
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, VOL 1, ASPLOS 2026
IF:
0
Papers:
17
Citations:
0

Organization

N
National University of Singapore
Scholars:
7.6W
Papers: 6.5W
Citations: 11.4W
Cited Papers

Cited Papers

Scalable interconnects for reconfigurable spatial architectures
err2019-06-22
err0
PREAI
errYaqi Zhang; Alexander Rucker; Matthew Vilim; Raghu Prabhakar; William Hwang; Kunle Olukotun
errShare
errSave
CGRA-ME: A unified framework for CGRA modelling and exploration
err2017-07-01
err0
PREAI
errS. Alexander Chin; Noriaki Sakamoto; Allan Rui; Jim Zhao; Jin Hee Kim; Yuko Hara-Azumi; Jason Anderson
errShare
errSave
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
err2025-01-01
err0
PREAI
errYuan,Jingyang; Gao,Huazuo; Dai,Damai; Luo,Junyu; Zhao,Liang; Zhang,Zhengyan; Xie,Zhenda; Wei,Yuxing; Wang,Lean; Xiao,Zhiping; Wang,Yuqing; Ruan,Chong; Zhang,Ming; Liang,Wenfeng; Zeng,Wangding
errShare
errSave
TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings
err2023-06-17
err0
errOAAI
errNorm Jouppi; George Kurian; Sheng Li; Peter Ma; Rahul Nagarajan; Lifeng Nai; Nishant Patil; Suvinay Subramanian; Andy Swing; Brian Towles; Clifford Young; Xiang Zhou; Zongwei Zhou; David A Patterson
errShare
errSave
NVIDIA A100 Tensor Core GPU: Performance and Innovation
err2021-03-01
err0
PREAI
errJack Choquette; Wishwesh Gandhi; Olivier Giroux; Nick Stam; Ronny Krashinsky
errShare
errSave
SIGMA: A Sparse and Irregular GEMM Accelerator with Flexible Interconnects for DNN Training
err2020-02-01
err0
PREAI
errEric Qin; Ananda Samajdar; Hyoukjun Kwon; Vineet Nadella; Sudarshan Srinivasan; Dipankar Das; Bharat Kaul; Tushar Krishna
errShare
errSave
Pipestitch: An energy-minimal dataflow architecture with lightweight threads
err
IF0
err2023-12-08
err0
PREAI
errNathan Serafin; Souradip Ghosh; Harsh Desai; Nathan Beckmann; Brandon Lucia
errShare
errSave
researcher View more