.png){kind=icon}
返回
A Declarative Metamorphic Testing Framework for Autonomous Driving
.png){kind=icon}
OA
AI
DOI：10.1109/TSE.2022.3206427.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Autonomous driving has gained much attention from both industry and academia. Currently, Deep Neural Networks (DNNs) are widely used for perception and control in autonomous driving. However, several fatal accidents caused by autonomous vehicles have raised serious safety concerns about autonomous driving models. Some recent studies have successfully used the metamorphic testing technique to detect thousands of potential issues in some popularly used autonomous driving models. However, prior study is limited to a small set of metamorphic relations, which do not reflect rich, real-world traffic scenarios and are also not customizable. This paper presents a novel declarative rule-based metamorphic testing framework called RMT. RMT provides a rule template with natural language syntax, allowing users to flexibly specify an enriched set of testing scenarios based on real-world traffic rules and domain knowledge. RMT automatically parses human-written rules to metamorphic relations using an NLP-based rule parser referring to an ontology list and generates test cases with a variety of image transformation engines. We evaluated RMT on three autonomous driving models. With an enriched set of metamorphic relations, RMT detected a significant number of abnormal model predictions that were not detected by prior work. Through a large-scale human study on Amazon Mechanical Turk, we further confirmed the authenticity of test cases generated by RMT and the validity of detected abnormal model predictions.
Keyword:
Testing
Autonomous vehicles
Predictive models
Roads
Ontologies
Vehicles
Natural languages
Metamorphic testing
Autonomous driving
testing
期刊
IF:
5.6
论文数:
2.9K
被引数:
1.1W
机构
引用论文
Molecular motion in plastic phases of organometallic compounds: iron-57 Mössbauer and carbon-13 n.m.r. spectra of tricarbonyl(1–5-hapto-cyclohexadienyl)iron tetrafluoroborate and related compounds有机金属化合物的塑料相中的分子运动: 铁-57 m ö ssbauer和碳-13 n.m.r.三羰基 (1-5-半环己二烯基) 四氟硼酸铁和相关化合物的光谱
.png){kind=icon}
PREAI
分享收藏Ureteral Reconstruction With Bowel Segments: Experience With Eight Patients in a Single Institute
OAAI
OAAI分享收藏分享收藏Association of vitamin D receptor gene polymorphism with the risk of systemic lupus erythematosus维生素d受体基因多态性与系统性红斑狼疮发病风险的相关性研究
PREAI
分享收藏Thermal expansions of Ln2Zr2O7 (Ln = La, Nd, Sm, and Gd) pyrochloreLn2Zr2O7 (ln = La，Nd，Sm和Gd) 烧绿石的热膨胀
PREAI
分享收藏
查看更多内容