arrow
返回

High-Throughput Energy-Efficient Accelerator With Collaborative-Trainable Sparse-Quantization Method for On-Board Remote Sensing Processing

delete2025-01-01
delete0
PRE
AI
T
Tong Wang
H
He Chen
N
Ning Zhang *
S
Shuo Ni
X
Xi Zhang
L
Liang Chen
李
李伟 (Wei Li)
DOI:10.1109/TGRS.2025.3616011delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Convolutional neural networks (CNNs) have achieved remarkable breakthroughs on remote sensing tasks in recent years. However, deploying CNNs for real-time remote sensing on-board processing still remains a challenge due to power consumption, real-time, and other limitations. Therefore, in this article, a satellite-based real-time remote sensing accelerator is proposed, where algorithm and hardware approaches are proposed to jointly optimize CNNs' deployment on edge-side aerospace devices. First, a collaborative-trainable sparse-quantization (CTSQ) method is proposed to reduce the model's storage overhead. In the CTSQ method, analysis of the errors is performed for the sparsity-quantization composition. Besides, the interchannel correlations among parameters are leveraged, where the structured sparsity and quantization are performed with fine-grained units. Second, a modular-system co-optimized (MoSyC) architecture is proposed. A hardware-mapped sparse access (HMSA) strategy is proposed to effectively filter out zero elements in sparse parameters. Moreover, a high-throughput architecture is designed for parallel and pipelined data flow control. Finally, extensive experiments are conducted on both scene classification and object detection tasks with ResNet and YOLOv5 models. The results show that the proposed CTSQ method achieves the compression ratio of more than $13.81\times $ , and the proposed MoSyC architecture achieves the throughput of more than 1815 giga operations per second (GOPS), demonstrating the effectiveness of the proposed accelerator.
Keyword:
Quantization (signal)
Computer architecture
Neural networks
Training
Remote sensing
Hardware
Optimization
Real-time systems
Accuracy
Throughput
Convolutional neural network (CNN)
field programmable gate array (FPGA)
quantization
real-time
remote sensing
sparsity

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
引用论文

引用论文

A Reconfigurable Neural Network Processor With Tile-Grained Multicore Pipeline for Object Detection on FPGA
err
IF0
err2021-11-01
err0
PREAI
errLibo Chang; Shengbing Zhang; Huimin Du; Yue Chen; Shiyu Wang
err分享
err收藏
Dynamical Channel Pruning by Conditional Accuracy Change for Deep Neural Networks
err2021-02-01
err52
PREAI
errChen, Zhiqiang; Xu, Ting-Bing; Du, Changde; Liu, Cheng-Lin; He, Huiguang
err分享
err收藏
学者 查看更多内容