.png){kind=icon}
返回
Heterogeneous Sensor Data Fusion By Deep Multimodal Encoding
.png){kind=icon}
PRE
AI
DOI：10.1109/JSTSP.2017.2679538.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Heterogeneous sensor data fusion is a challenging field that has gathered significant interest in recent years. Two of these challenges are learning from data with missing values, and finding shared representations for multimodal data to improve inference and prediction. In this paper, we propose a multimodal data fusion framework, the deep multimodal encoder (DME), based on deep learning techniques for sensor data compression, missing data imputation, and new modality prediction under multimodal scenarios. While traditional methods capture only the intramodal correlations, DME is able to mine both the intramodal correlations in the initial layers and the enhanced intermodal correlations in the deeper layers. In this way, the statistical structure of sensor data may be better exploited for data compression. By incorporating our new objective function, DME shows remarkable ability for missing data imputation tasks in sensor data. The shared multimodal representation learned by DME may be used directly for predicting new modalities. In experiments with a real-world dataset collected from a 40-node agriculture sensor network which contains three modalities, DME can achieve a root mean square error (RMSE) of missing data imputation which is only 20% of the traditional methods like K-nearest neighbors and sparse principal component analysis and the performance is robust to different missing rates. It can also reconstruct temperature modality from humidity and illuminance with an RMSE of 7 degrees C, directly from a highly compressed (2.1%) shared representation that was learned from incomplete (80% missing) data.
Keyword:
Deep learning
heterogeneous sensor data
multimodal data fusion
missing data imputation
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
13.7
论文数:
1.9K
被引数:
1.1W
机构
引用论文
分享收藏Normative pediatric visual acuity using single surrounded HOTV optotypes on the Electronic Visual Acuity Tester following the Amblyopia Treatment Study protocol根据弱视治疗研究方案，在电子视力测试仪上使用单个包围的HOTV视标的儿童视力
OAAI
OAAI分享收藏Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition用于多模式可穿戴活动识别的深度卷积和LSTM循环神经网络.png)
SENSORSOAAI
SENSORSIF3.5
OAAI分享收藏
查看更多内容