arrow
Return

Eliminating Redundancy: Ultra-compact Code Generation for Programmable Dataflow Accelerators

delete2026-01-01
delete0
PRE
AI
P
Prasanth Chatarasi *
A
Alex Gatea
B
Bardia Mahjour
J
Jintao Zhang
A
Alberto Mannari
C
Chris Bowler
S
Shubham Jain
M
Masoud Ataei Jaliseh
N
Nicole Khoun
K
Kamlesh Kumar
V
Viji Srinivasan
S
Swagath Venkataramani
DOI:10.1109/CGO68049.2026.11395195delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Modern AI accelerators adopt dataflow architectures to achieve both high peak throughput (TOPS) and energy efficiency (TOPS/W). These designs feature wide datapaths and hierarchical scratchpad memories that supply dense compute arrays with high-bandwidth data access and extensive operand reuse. Complementing the compute-memory subsystem is a lightweight control path that orchestrates data movement, program loading, and register initialization. To reduce energy and area overheads, conventional processor features-such as instruction caches, execution stacks, and branch speculation-are deliberately omitted. While this streamlined design maximizes efficiency, it shifts a critical responsibility onto the compiler: transforming complex kernels into highly compact instruction streams that must fit entirely within the limited instruction buffers (IBUFFs) of the accelerator's programmable units. In this paper, we introduce two novel compiler transformations-Loop Absorption (LA) and Loop Index Set Merging (LISM) for ultra compact code generation. Loop Absorption merges isomorphic sibling operations into a single loop body, while LISM unifies adjacent loops with similar bodies into a unified iteration space. Together, these complementary techniques eliminate redundant code patterns and produce compact hierarchical loop nests. We implement LA and LISM in the IBM Spyre compiler and evaluate them on diverse deep learning workloads including ResNet-50, Inception-v3, SSD, and BERT-Large. Across these models, our combined approach achieves a geometric mean compression of 1.48x over the baseline, enabling layers that previously exceeded IBUFF capacity to compile successfully.
Keywords:
Loop Absorption
Loop Index Set Merging
Dataflow Accelerators
Compiler Optimization
Code Compression

Journal

2
2026 IEEE/ACM INTERNATIONAL SYMPOSIUM ON CODE GENERATION AND OPTIMIZATION, CGO
IF:
0
Papers:
48
Citations:
0

Organization

I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
I
ibm usa
Scholars:
1.4K
Papers: 1.0K
Citations: 0
Cited Papers

Cited Papers

ExTensor
err2019-10-12
err0
PREAI
errKartik Hegde; Hadi Asghari-Moghaddam; Michael Pellauer; Neal Crago; Aamer Jaleel; Edgar Solomonik; Joel Emer; Christopher W. Fletcher
errShare
errSave
MAERI
err2018-03-19
err0
PREAI
errHyoukjun Kwon; Ananda Samajdar; Tushar Krishna
errShare
errSave
Loop Rolling for Code Size Reduction
err2022-04-02
err0
PREAI
errRocha,Rodrigo C. O.; Petoumenos,Pavlos; Franke,Bjorn; Bhatotia,Pramod; O'Boyle,Michael
errShare
errSave
MTIA: First Generation Silicon Targeting Meta's Recommendation Systems
err2023-06-17
err0
PREAI
errAmin Firoozshahian; Joel Coburn; Roman Levenstein; Rakesh Nattoji; Ashwin Kamath; Olivia Wu; Gurdeepak Grewal; Harish Aepala; Bhasker Jakka; Bob Dreyer; Adam Hutchin; Utku Diril; Krishnakumar Nair; Ehsan K. Aredestani; Martin Schatz; Yuchen Hao; Rakesh Komuravelli; Kunming Ho; Sameer Abu Asal; Joe Shajrawi; Kevin Quinn; Nagesh Sreedhara; Pankaj Kansal; Willie Wei; Dheepak Jayaraman; Linda Cheng; Pritam Chopda; Eric Wang; Ajay Bikumandla; Arun Karthik Sengottuvel; Krishna Thottempudi; Ashwin Narasimha; Brian Dodds; Cao Gao; Jiyuan Zhang; Mohammed Al-Sanabani; Ana Zehtabioskuie; Jordan Fix; Hangchen Yu; Richard Li; Kaustubh Gondkar; Jack Montgomery; Mike Tsai; Saritha Dwarakapuram; Sanjay Desai; Nili Avidan; Poorvaja Ramani; Karthik Narayanan; Ajit Mathews; Sethu Gopal; Maxim Naumov; Vijay Rao; Krishna Noru; Harikrishna Reddy; Prahlad Venkatapuram; Alexis Bjorlin
errShare
errSave
RaPiD: AI Accelerator for Ultra-low Precision Training and Inference
err2021-06-01
err0
PREAI
errSwagath Venkataramani; Vijayalakshmi Srinivasan; Wei Wang; Sanchari Sen; Jintao Zhang; Ankur Agrawal; Monodeep Kar; Shubham Jain; Alberto Mannari; Hoang Tran; Yulong Li; Eri Ogawa; Kazuaki Ishizaki; Hiroshi Inoue; Marcel Schaal; Mauricio Serrano; Jungwook Choi; Xiao Sun; Naigang Wang; Chia-Yu Chen; Allison Allain; James Bonano; Nianzheng Cao; Robert Casatuta; Matthew Cohen; Bruce Fleischer; Michael Guillorn; Howard Haynie; Jinwook Jung; Mingu Kang; Kyu-hyoun Kim; Siyu Koswatta; Saekyu Lee; Martin Lutz; Silvia Mueller; Jinwook Oh; Ashish Ranjan; Zhibin Ren; Scot Rider; Kerstin Schelm; Michael Scheuermann; Joel Silberman; Jie Yang; Vidhi Zalani; Xin Zhang; Ching Zhou; Matt Ziegler; Vinay Shah; Moriyoshi Ohara; Pong-Fei Lu; Brian Curran; Sunil Shukla; Leland Chang; Kailash Gopalakrishnan
errShare
errSave
Partial redundancy elimination in SSA form
err1999-05-01
err0
PREAI
errKennedy,Robert; Chan,Sun; Liu,Shin-Ming; Lo,Raymond; Tu,Peng; Chow,Fred
errShare
errSave
researcher View more