arrow
Return

DIBA: A Re-Configurable Stream Processor

delete2024-09-01
delete0
delete
OA
AI
M
Mohammadreza Najafi
T
Thamir M. Qadah *
M
Mohammad Sadoghi
H
Hans‐Arno Jacobsen
DOI:10.1109/TKDE.2024.3381192delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Stream processing acceleration is driven by the continuously increasing volume and velocity of data generated on the Web and the limitations of storage, computation, and power consumption. Hardware solutions provide better performance and power consumption, but they are hindered by the high research and development costs and the long time to market. In this work, we propose our re-configurable stream processor (Diba), a complete rethinking of a previously proposed customized and flexible query processor that targets real-time stream processing. Diba uses a unidirectional dataflow not dedicated to any specific type of query (operator) on streams, allowing a straightforward placement of processing components on a general data path that facilitates query mapping. In Diba, the concepts of the distribution network and processing components are implemented as two separate entities connected using generic interfaces. This approach allows the adoption of a versatile architecture for a family of queries rather than forcing a rigid chain of processing components to implement such queries. Our experimental evaluations of representative queries from TPC-H yielded processing times of 300, 1220, and 3520 milliseconds for data streams with scale factor sizes of one, four, and ten gigabytes, respectively.
Keywords:
Query processing
Computer architecture
Field programmable gate arrays
Libraries
Hardware acceleration
Engines
Pipelines
Dataflow architecture
hardware architecture
multiple data stream architecture

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

U
university of california davis
Scholars:
3.4W
Papers: 2.6W
Citations: 45
U
Umm Al Qura University
Scholars:
2.9K
Papers: 3.1K
Citations: 4
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
T
Technical University of Munich
Scholars:
5.2W
Papers: 3.9W
Citations: 6.2W
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
ScaleJoin: A Deterministic, Disjoint-Parallel and Skew-Resilient Stream Join
err2021-06-01
err16
PREAI
errGulisano, Vincenzo; Nikolakopoulos, Yiannis; Papatriantafilou, Marina; Tsigas, Philippas
errShare
errSave
Laparoscopic removal of mullerian remnants in a woman with congenital absence of the vagina
err1992-01-01
err0
PREAI
errTimothy R. Yeko; Anna K. Parsons; Roger Marshall; George Maroulis
errShare
errSave
researcher View more