arrow
返回

Crash data augmentation using variational autoencoder

delete2021-03-01
delete118
PRE
AI
Z
Zubayer Islam *
M
Mohamed Abdel‐Aty
Q
Qing Cai
J
Jinghui Yuan
DOI:10.1016/j.aap.2020.105950delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we present a data augmentation technique to reproduce crash data. The dataset comprising crash and non-crash events are extremely imbalanced. For instance, the dataset used in this paper consists of only 625 crash events for over 6.5 million non-crash events. Thus, learning algorithms tend to perform poorly on these datasets. We have used variational autoencoder to encode all the events into a latent space. After training, the model could successfully separate crash and non-crash events. To generate data, we sampled from the latent space containing crash data. The generated data was compared with the real data from different statistical aspects. t-Test, Levene-test and Kolmogrove Smirnov test showed that the generated data was statistically similar to the real data. It was also compared to some of the minority oversampling techniques like SMOTE and ADASYN as well as the GAN framework for generating data. Crash prediction models based on Logistic Regression (LR), Support Vector Machine (SVM) and Artificial Neural Network (ANN) were used to compare the generated data from the different oversampling techniques. Overall, variational autoencoder (VAE) showed excellent results compared to the other data augmentation methods. Specificity is improved by 8% and 4% for VAE-LR and VAE-SVM respectively when compared to SMOTE while the sensitivity is improved by 6% and 5% when compared to ADASYN. Moreover, VAE generated data also helps to overcome the overfitting problem in SMOTE and ADASYN since there is flexibility in choosing the decision boundary.
Keyword:
Variational autoencoder
Data augmentation
Crash prediction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

A
Accident Analysis and Prevention
IF:
6.2
论文数:
7.6K
被引数:
3.2W

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.8W
论文数: 10.9W
被引数: 130
引用论文

引用论文

Analysis of Factors Affecting Real-Time Ridesharing Vehicle Crash Severity
err2019-06-17
err6
errOAAI
errZhou, Bei; Zhang, Xinfen; Zhang, Shengrui; Li, Zongzhi; Liu, Xin
err分享
err收藏
Significant Rewiring of the Transcriptome and Proteome of an Escherichia coli Strain Harboring a Tailored Exogenous Global Regulator IrrE
err2012-07-05
err0
errOAAI
errTingjian Chen; Jianqing Wang; Lingli Zeng; Rizong Li; Jicong Li; Yilu Chen; Zhanglin Lin
err分享
err收藏
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
err分享
err收藏
学者 查看更多内容