.png){kind=icon}
返回
Diffusion-driven Incomplete Multimodal Learning for Air Quality Prediction
.png){kind=icon}
OA
AI
DOI：10.1145/3702243.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Predicting air quality using multimodal data is crucial to comprehensively capture the diverse factors influencing atmospheric conditions. Therefore, this study introduces a multimodal learning framework that integrates outdoor images with traditional ground-based observations to improve the accuracy and reliability of air quality predictions. However, aligning and fusing these heterogeneous data sources poses a formidable challenge, further exacerbated by pervasive data incompleteness issues in practice. In this article, we propose a novel incomplete multimodal learning approach (iMMAir) to recovery missing data for robust air quality prediction. Specifically, we first design a shallow feature extractor to capture modal-specific features within the latent representation space. Then we develop a conditional diffusion-driven recovery module to mitigate the distribution gap between the recovered and true data. This module further incorporates two conditional constraints of temporal correlation and semantic consistency for effective modal completion. Finally, we reconstruct incomplete modalities and fuse available data using a multimodal transformer network to predict the air quality. To alleviate the modality imbalance problem, we employ an adaptive gradient modulation strategy to adjust the optimization of each modality. Experimental results demonstrate that iMMAir significantly reduces prediction errors, outperforming baseline models by an average of 5.6% and 2.5% in air quality regression and classification tasks. Our source code and data are available at https://github.com/pestasu/IMMAir.
Keyword:
Incomplete multimodal learning
air quality prediction
diffusion model
期刊
IF:
4.1
论文数:
896
被引数:
1.9K
机构
引用论文
Num2vec: Pre-Training Numeric Representations for Time Series Forecasting in the Sensing System
PREAI
分享收藏Multimodal remote sensing benchmark datasets for land cover classification with a shared and specific feature learning model具有共享和特定特征学习模型的多模态遥感基准数据集，用于土地覆盖分类
OAAI
OAAI分享收藏PM2.5 Concentration Estimation Based on Image Processing Schemes and Simple Linear Regression.png)
SENSORSOAAI
SENSORSIF3.5
OAAI分享收藏
查看更多内容