arrow
Return

PartialHD: Toward Efficient Hyperdimensional Computing by Partial Processing

delete2024-01-01
delete2
PRE
AI
F
Farhad Taheri
S
Siavash Bayat-Sarmadi *
H
Hamed Rastaghi
DOI:10.1109/JIOT.2023.3287316delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Hyperdimensional (HD) computing is a brain-inspired learning method that is widely employed in resource-constrained applications, such as the Internet of Things (IoT) regarding its lightweight computation. Although HD computing has high efficiency in the IoT applications, it suffers from high computation due to the large vector size. Thus, several studies are proposed to speedup and increase the efficiency of HD computing. In this work, we propose a method to process HD computing called PartialHD. Our method divides a long hypervector into multiple partial vectors and processes each vector separately. In the retraining phase, this method improves accuracy up to 1.93%. Moreover, by employing our proposed method in the retraining and inference, only a few partial vectors participate and this causes the computational overhead reduces in these phases. The evaluation shows that our method processes on average 22.2% and 36.23% of the entire hypervectors with negligible accuracy loss in inference and retraining, respectively. Furthermore, we propose two general architectures (lightweight and high-speed), which accelerate partial vector computations on different FPGA platforms. The result shows that the lightweight architecture can accelerate HD computing on resource-constrained FPGAs such as Artix while the high-speed architecture has 4.72 x higher throughput than the lightweight architecture.
Keywords:
Computer architecture
Internet of Things
Field programmable gate arrays
Training
Encoding
Training data
Task analysis
Acceleration
FPGA design
hyperdimensional (HD) computing
retraining

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

S
Sharif University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 9.5K