arrow
返回

Reinforcement Learning for Adaptive Video Compressive Sensing

delete2023-08-11
delete0
delete
OA
AI
S
Sidi Lu *
X
Xin Yuan
A
Aggelos K. Katsaggelos
W
Weisong Shi
DOI:10.1145/3608479delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We apply reinforcement learning to video compressive sensing to adapt the compression ratio. Specifically, video snapshot compressive imaging (SCI), which captures high-speed video using a low-speed camera is considered in this work, in which multiple (B) video frames can be reconstructed from a snapshot measurement. One research gap in previous studies is how to adapt B in the video SCI system for different scenes. In this article, we fill this gap utilizing reinforcement learning (RL). An RL model, as well as various convolutional neural networks for reconstruction, are learned to achieve adaptive sensing of video SCI systems. Furthermore, the performance of an object detection network using directly the video SCI measurements without reconstruction is also used to perform RL-based adaptive video compressive sensing. Our proposed adaptive SCI method can thus be implemented in low cost and real time. Our work takes the technology one step further towards real applications of video SCI.
Keyword:
Image processing
compressive sensing
reinforcement learning

期刊

ACM Transactions on Intelligent Systems and Technology 封面图
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
论文数:
1.5K
被引数:
6.2K

机构

U
University of Delaware
学者数:
1.3W
论文数: 1.3W
被引数: 2.0W
W
westlake university
学者数:
5.3K
论文数: 3.7K
被引数: 8
N
Northwestern University
学者数:
6.2W
论文数: 5.3W
被引数: 3.9K
学者 查看更多机构
引用论文

引用论文

The Crystal Structure of Abl Kinase with BMS-354825, a Dual SRC/ABL Kinase Inhibitor.
err2004-11-16
err0
PREAI
errJohn S. Tokarski; John Newitt; Francis Y. Lee; Louis Lombardo; Robert Borzilleri; Kevin Kish; Dianlin Xie; Yaqun Zhang; Janet D. Cheng; Susan E. Kiefer; Chieh Ying J. Chang; Herbert E. Klei
err分享
err收藏
err分享
err收藏
High spatio-temporal resolution video with compressed sensing
err2015-06-09
err77
errOAAI
errKoller, Roman; Schmid, Lukas; Matsuda, Nathan; Niederberger, Thomas; Spinoulas, Leonidas; Cossairt, Oliver; Schuster, Guido; Katsaggelos, Aggelos K.
err分享
err收藏
err分享
err收藏
Video Compressive Sensing Using Gaussian Mixture Models
err2014-11-01
err176
PREAI
errYang, Jianbo; Yuan, Xin; Liao, Xuejun; Llull, Patrick; Brady, David J.; Sapiro, Guillermo; Carin, Lawrence
err分享
err收藏
err分享
err收藏
学者 查看更多内容