Efficient Quantization and Data Access for Accelerating Homomorphic Encrypted CNNs

doi:10.3390/electronics14030464

Efficient Quantization and Data Access for Accelerating Homomorphic Encrypted CNNs

2025-01-23

0

OA

AI

DOI：10.3390/electronics14030464

Original

Original request for help

Save

Abstract

En 中文

Due to the ability to perform computations directly on encrypted data, homomorphic encryption (HE) has recently become an important branch of privacy-preserving machine learning (PPML) implementation. Nevertheless, existing implementations of HE-based convolutional neural network (HCNN) applications are not satisfactory in inference latency and area efficiency compared to the unencrypted version. In this work, we first improve the additive powers-of-two (APoT) quantization method for HCNN to achieve a better tradeoff between the complexity of modular multiplication and the network accuracy. An efficient multiplicationless modular multiplier-accumulator (M-MAC) unit is accordingly designed. Furthermore, a batch-processing HCNN accelerator with M-MACs is implemented, in which we propose an advanced data partition scheme to avoid multiple moves of the large-size ciphertext polynomials. Compared to the latest FPGA design, our accelerator can achieve 11x resource reduction of an M-MAC and 2.36x speedup in inference latency for a widely used CNN-11 network to process 8K images. The speedup of our design is also significant compared to the latest CPU and GPU implementations of the batch-processing HCNN models.

Keywords:

homomorphic encryption

convolutional neural network

modular multiplication

hardware acceleration

Efficient Quantization and Data Access for Accelerating Homomorphic Encrypted CNNs

Abstract

Journal

Organization