arrow
返回

Automatic Fault Detection for Deep Learning Programs Using Graph Transformations

delete2021-09-28
delete16
delete
OA
AI
A
Amin Nikanjam *
H
Houssem Ben Braiek
M
Mohammad Mehdi Morovati
F
Foutse Khomh
DOI:10.1145/3470006delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Nowadays, we are witnessing an increasing demand in both corporates and academia for exploiting Deep Learning (DL) to solve complex real-world problems. A DL program encodes the network structure of a desirable DL model and the process by which the model learns from the training dataset. Like any software, a DL program can be faulty, which implies substantial challenges of software quality assurance, especially in safety-critical domains. It is therefore crucial to equip DL development teams with efficient fault detection techniques and tools. In this article, we propose NeuraLint, a model-based fault detection approach for DL programs, using meta-modeling and graph transformations. First, we design a meta-model for DL programs that includes their base skeleton and fundamental properties. Then, we construct a graph-based verification process that covers 23 rules defined on top of the meta-model and implemented as graph transformations to detect faults and design inefficiencies in the generated models (i.e., instances of the meta-model). First, the proposed approach is evaluated by finding faults and design inefficiencies in 28 synthesized examples built from common problems reported in the literature. Then NeuraLint successfully finds 64 faults and design inefficiencies in 34 real-world DL programs extracted from Stack Overflow posts and GitHub repositories. The results show that NeuraLint effectively detects faults and design issues in both synthesized and realworld examples with a recall of 70.5% and a precision of 100%. Although the proposed meta-model is designed for feedforward neural networks, it can be extended to support other neural network architectures such as recurrent neural networks. Researchers can also expand our set of verification rules to cover more types of issues in DL programs.
Keyword:
Graph transformations
model-based verification
deep learning
fault detection

期刊

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
论文数:
1.2K
被引数:
3.4K

机构

U
universite de montreal
学者数:
4.6W
论文数: 3.8W
被引数: 46
K
K. N. Toosi University of Technology
学者数:
5.3K
论文数: 5.1K
被引数: 3
引用论文

引用论文

Hair cell regeneration in the bird cochlea following noise damage or ototoxic drug damage
err1994-01-01
err0
PREAI
errDouglasA. Cotanche; KennethH. Lee; JenniferS. Stone; DanielA. Picard
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Mutation in the Mismatch Repair Gene Msh6 Causes Cancer Susceptibility
errCell
IF0
err1997-11-01
err0
errOAAI
errWinfried Edelmann; Kan Yang; Asad Umar; Joerg Heyer; Kirkland Lau; Kunhua Fan; Wolfgang Liedtke; Paula E Cohen; Michael F Kane; James R Lipford; Nianjun Yu; Gray F Crouse; Jeffrey W Pollard; Thomas Kunkel; Martin Lipkin; Richard Kolodner; Raju Kucherlapati
err分享
err收藏
学者 查看更多内容