.png){kind=icon}
返回
Rethinking self-supervised learning for time series forecasting: A temporal perspective
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2024.112652.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Self-supervised learning has garnered significant attention for its ability to learn meaningful representations. Recent advancements have introduced self-supervised methods for time series forecasting. However, these efforts have faced limitations due to two primary drawbacks. Firstly, these approaches often borrow techniques from vision and language domains without adequately addressing the unique temporal dependencies inherent in time series data. Secondly, time series often show that the distribution shifts over time, which makes accurate forecasting challenging. In response to these issues, we propose TempSSL, a self-supervised learning framework designed for time series forecasting. TempSSL divides the time series data into context (history data) and target (future data), employing two pre-training strategies: (1) Temporal Masked Modeling (TMM) designed to capture temporal dependencies by reconstructing future time series based on historical context; (2) Temporal Contrastive Learning (TCL) employs context and target as positive samples to enhance discriminative representations and mitigate distribution shifts within the time series. TempSSL's innovation lies in two key aspects. Firstly, it underscores the importance of temporal dependencies for time series forecasting by designing specific pre-training tasks. Secondly, it effectively integrates contrastive learning and masked modeling, leveraging their respective strengths to develop time series representation with strong instance discriminability and local perceptibility. Extensive experiments across seven widely used benchmark datasets demonstrate that TempSSL consistently outperforms existing self-supervised and end-to-end forecasting methods, achieving improvements ranging from 1.92% similar to 78.12%. Additionally, TempSSL's practical effectiveness is further demonstrated through successful application in natural gas demand forecasting.
Keyword:
Time series forecasting
Masked modeling
Contrastive learning
Temporal dependencies
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Long sequence time-series forecasting with deep learning: A survey基于深度学习的长序列时间序列预测研究综述.png)
INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏Federated deep contrastive learning for mid-term natural gas demand forecasting联合深度对比学习在中期天然气需求预测中的应用APPLIED ENERGY
APPLIED ENERGYIF11
PREAI
分享收藏Neurologic Manifestations of Hospitalized Patients With Coronavirus Disease 2019 in Wuhan, China武汉地区2019例冠状病毒疾病住院患者的神经系统表现
OAAI
OAAI分享收藏
查看更多内容