返回
Photonic Tensor Processing Unit With Single Dataflow and Programmable High-Precision Weighting Control
DOI:10.1109/JLT.2023.3317090.png)
摘要
En 中文
With the explosive growth of data, tensor processing has emerged as a pivotal component of the next generation of artificial intelligence (AI) algorithms. Current photonic convolutional processors transform tensor convolutions into multi-channel general matrix multiplication (GeMM), which follows the path of electronic counterparts, leading to data replication and hardware complexity. In this study, we experimentally and theoretically demonstrate a photonic tensor processing unit (PTPU) with a single modulator, which offers a more concise approach for multi-channel standard tensor convolution processing, different from the channel-wise convolution method. By executing multi-tensor parallel computing instead of multi-channel parallel computing, PTPU can directly produce feature tensors without clock synchronization and delay compensation between multiple channels and allows more release of physical hardware resources. Furthermore, an integrated array of semiconductor optical amplifiers (SOAs) are used to be photonic synapses for programmable weight bank, demonstrating record-high precision of 9.2 bits for weights. In the proof-of-concept experiment, we extracted features from a 3-channel (RGB) image in horizontal and vertical directions, using integrated multi-wavelength photonic tensor kernels. We then built a 3D convolutional neural network to predict the presence of COVID-19 based on computer tomography (CT) scan data consisting of 64-channel tensors.
Keyword:
Multi-channel tensor convolution
photonic tensor processing unit
programmable weight bank
semiconductor optical amplifiers
期刊
IF:
4.8
论文数:
1.7W
被引数:
3.8W
机构
引用论文
Signal recovery in optical wireless communication using photonic convolutional processor
OPTICS EXPRESS
IF3.3
In-memory photonic dot-product engine with electrically programmable weight banks
NATURE COMMUNICATIONS
IF15.7
Optical patching scheme for optical convolutional neural networks based on wavelength-division multiplexing and optical delay lines
OPTICS LETTERS
IF3.3

