arrow
Return

Demystifying API misuses in deep learning applications

delete2024-02-16
delete0
PRE
AI
D
Deheng Yang
刘
刘逵 (Kui Liu)
雷
雷晏 (Yan Lei) *
L
Li Li
H
Huan Xie
C
Chunyan Liu
王振宇 cover
王振宇 (Zhenyu Wang)
X
Xiaoguang Mao
T
Tegawendé F. Bissyandé
DOI:10.1007/s10664-023-10413-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep Learning (DL) is achieving staggering performance on an increasing number of applications in various areas. Meanwhile, its associated data-driven programming paradigm comes with a set of challenges for the software engineering community, including the debugging activities for DL applications. Recent empirical studies on bugs in DL applications have shown that the API (i.e., Application Program Interface) misuse has been flagged as an important category of DL programming bugs. By exploring this literature towards API misuse bugs in DL applications, we identified three barriers that are locking an entire research direction. However, three barriers are hindering progress in this research direction: misclassification of API misuse bugs, lack of relevant dataset, and limited depth of analysis. Our work unlocks these barriers by providing an in-depth analysis of a frequent bug type that appears as a mystery. Concretely, we first offer a new perspective to a significant misclassification issue in the literature that hinders understanding of API misuses in DL applications. Subsequently, we curate the first dataset MisuAPI of 143 API misuses sampled from real-world DL applications. Finally, we perform systematic analyses to dissect API misuses and enumerate the symptoms of API misuses in DL applications as well as investigate the possibility of detecting them with state-of-the-art static analyzers. Overall, the insights summarized in this work are important for the community: 1) 18-35% of real API misuses are mislabelled in existing DL bug studies; 2) the widely adopted API misuse taxonomy, namely MUC, does not cover the cases of 1 out of 3 encountered API misuses; 3) DL library API misuses show significant differences from the general third-party library API misuses in terms of the API-usage element issue and symptoms; 4) Most (92.3%) API misuses lead to program crashes; 5) 95.8% API misuses remain undetectable by state-of-the-art static analyzers.
Keywords:
API misuse
Deep learning application
Bug dataset
Empirical study

Journal

Empirical Software Engineering cover
Empirical Software Engineering
IF:
3.6
Papers:
2.0K
Citations:
5.3K

Organization

H
huawei technologies
Scholars:
3.3K
Papers: 2.9K
Citations: 1
C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
U
university of luxembourg
Scholars:
5.2K
Papers: 4.8K
Citations: 4
researcher View more organizations
Cited Papers

Cited Papers

Classification of neck dissection: Variations on a new theme
err1994-11-01
err0
PREAI
errRonald H. Spiro; Elliot W. Strong; Jatin P. Shah
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Allele-Specific HLA Loss and Immune Escape in Lung Cancer Evolution
errCell
IF0
err2017-11-01
err0
errOAAI
errNicholas McGranahan; Rachel Rosenthal; Crispin T. Hiley; Andrew J. Rowan; Thomas B.K. Watkins; Gareth A. Wilson; Nicolai J. Birkbak; Selvaraju Veeriah; Peter Van Loo; Javier Herrero; Charles Swanton; Charles Swanton; Mariam Jamal-Hanjani; Selvaraju Veeriah; Seema Shafi; Justyna Czyzewska-Khan; Diana Johnson; Joanne Laycock; Leticia Bosshard-Carter; Rachel Rosenthal; Pat Gorman; Robert E. Hynds; Gareth Wilson; Nicolai J. Birkbak; Thomas B.K. Watkins; Nicholas McGranahan; Stuart Horswell; Richard Mitter; Mickael Escudero; Aengus Stewart; Peter Van Loo; Andrew Rowan; Hang Xu; Samra Turajlic; Crispin Hiley; Christopher Abbosh; Jacki Goldman; Richard Kevin Stone; Tamara Denner; Nik Matthews; Greg Elgar; Sophia Ward; Marta Costa; Sharmin Begum; Ben Phillimore; Tim Chambers; Emma Nye; Sofia Graca; Maise Al Bakir; Kroopa Joshi; Andrew Furness; Assma Ben Aissa; Yien Ning Sophia Wong; Andy Georgiou; Sergio Quezada; John A. Hartley; Helen L. Lowe; Javier Herrero; David Lawrence; Martin Hayward; Nikolaos Panagiotopoulos; Shyam Kolvekar; Mary Falzon; Elaine Borg; Teresa Marafioti; Celia Simeon; Gemma Hector; Amy Smith; Marie Aranda; Marco Novelli; Dahmane Oukrif; Sam M. Janes; Ricky Thakrar; Martin Forster; Tanya Ahmad; Siow Ming Lee; Dionysis Papadatos-Pastos; Dawn Carnell; Ruheena Mendes; Jeremy George; Neal Navani; Asia Ahmed; Magali Taylor; Junaid Choudhary; Yvonne Summers; Raffaele Califano; Paul Taylor; Rajesh Shah; Piotr Krysiak; Kendadai Rammohan; Eustace Fontaine; Richard Booton; Matthew Evison; Phil Crosbie; Stuart Moss; Faiza Idries; Leena Joseph; Paul Bishop; Anshuman Chaturved; Anne Marie Quinn; Helen Doran; Angela Leek; Phil Harrison; Katrina Moore; Rachael Waddington; Juliette Novasio; Fiona Blackhall; Jane Rogan; Elaine Smith; Caroline Dive; Jonathan Tugwood; Ged Brady; Dominic G. Rothwell; Francesca Chemi; Jackie Pierce; Sakshi Gulati; Babu Naidu; Gerald Langman; Simon Trotter; Mary Bellamy; Hollie Bancroft; Amy Kerr; Salma Kadiri; Joanne Webb; Gary Middleton; Madava Djearaman; Dean Fennell; Jacqui A. Shaw; John Le Quesne; David Moore; Apostolos Nakas; Sridhar Rathinam; William Monteiro; Hilary Marshall; Louise Nelson; Jonathan Bennett; Joan Riley; Lindsay Primrose; Luke Martinson; Girija Anand; Sajid Khan; Anita Amadi; Marianne Nicolson; Keith Kerr; Shirley Palmer; Hardy Remmen; Joy Miller; Keith Buchan; Mahendran Chetty; Lesley Gomersall; Jason Lester; Alison Edwards; Fiona Morgan; Haydn Adams; Helen Davies; Malgorzata Kornaszewska; Richard Attanoos; Sara Lock; Azmina Verjee; Mairead MacKenzie; Maggie Wilcox; Harriet Bell; Allan Hackshaw; Yenting Ngai; Sean Smith; Nicole Gower; Christian Ottensmeier; Serena Chee; Benjamin Johnson; Aiman Alzetani; Emily Shaw; Eric Lim; Paulo De Sousa; Monica Tavares Barbosa; Alex Bowman; Simon Jordan; Alexandra Rice; Hilgardt Raubenheimer; Chiara Proli; Maria Elena Cufari; John Carlo Ronquillo; Angela Kwayie; Harshil Bhayani; Morag Hamilton; Yusura Bakar; Natalie Mensah; Lyn Ambrose; Anand Devaraj; Silviu Buderi; Jonathan Finch; Leire Azcarate; Hema Chavan; Sophie Green; Hillaria Mashinga; Andrew G. Nicholson; Kelvin Lau; Michael Sheaff; Peter Schmid; John Conibear; Veni Ezhil; Babikir Ismail; Melanie Irvin-sellers; Vineet Prakash; Peter Russell; Teresa Light; Tracey Horey; Sarah Danson; Jonathan Bury; John Edwards; Jennifer Hill; Sue Matthews; Yota Kitsanta; Kim Suvarna; Patricia Fisher; Allah Dino Keerio; Michael Shackcloth; John Gosney; Pieter Postmus; Sarah Feeney; Julius Asante-Siaw; Hugo J.W.L. Aerts; Stefan Dentro; Christophe Dessimoz
errShare
errSave
Overexpression of Mitochondrial IF1 Prevents Metastatic Disease of Colorectal Cancer by Enhancing Anoikis and Tumor Infiltration of NK Cells
err2019-12-19
err0
errOAAI
errLucía González-Llorente; Fulvio Santacatterina; Ana García-Aguilar; Cristina Nuevo-Tapioles; Sara González-García; Zuzana Tirpakova; María Luisa Toribio; José M. Cuezva
errShare
errSave
errShare
errSave
researcher View more