arrow
返回

TinyPredNet: A Lightweight Framework for Satellite Image Sequence Prediction

delete2024-01-22
delete1
PRE
AI
K
Kuai Dai
李
李旭涛 (Xutao Li) *
H
Huiwei Lin
Y
Yin Jiang
X
Xunlai Chen
Y
Yunming Ye
D
Di Xian
DOI:10.1145/3638773delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Satellite image sequence prediction aims to precisely infer future satellite image frames with historical observations, which is a significant and challenging dense prediction task. Though existing deep learning models deliver promising performance for satellite image sequence prediction, the methods suffer from quite expensive training costs, especially in training time and GPU memory demand, due to the inefficiently modeling for temporal variations. This issue seriously limits the lightweight application in satellites such as space-borne forecast models. In this article, we propose a lightweight prediction framework TinyPredNet for satellite image sequence prediction, in which a spatial encoder and decoder model the intra-frame appearance features and a temporal translator captures inter-frame motion patterns. To efficiently model the temporal evolution of satellite image sequences, we carefully design a multi-scale temporal-cascaded structure and a channel attention-gated structure in the temporal translator. Comprehensive experiments are conducted on FengYun4A (FY-4A) satellite dataset, which show that the proposed framework achieves very competitive performance with much lower computation cost compared to state-of-the-art methods. In addition, corresponding interpretability experiments are conducted to show how our designed structures work. We believe the proposed method can serve as a solid lightweight baseline for satellite image sequence prediction.
Keyword:
Satellite image sequence prediction
deep learning
lightweight
interpretability

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
C
China Meteorological Administration
学者数:
8.1K
论文数: 6.3K
被引数: 5.3K
学者 查看更多机构
引用论文

引用论文

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力,对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
err分享
err收藏
Estimating Summertime Precipitation from Himawari-8 and Global Forecast System Based on Machine Learning基于机器学习的Himawari-8和全球预报系统估算夏季降水
err2019-05-01
err109
PREAI
errMin, Min; Bai, Chen; Guo, Jianping; Sun, Fenglin; Liu, Chao; Wang, Fu; Xu, Hui; Tang, Shihao; Li, Bo; Di, Di; Dong, Lixin; Li, Jun
err分享
err收藏
学者 查看更多内容