arrow
Return

Software testing and Android applications: a large-scale empirical study

delete2021-12-14
delete15
PRE
AI
F
Fabiano Pecorelli *
G
Gemma Catolino
F
Filomena Ferrucci
A
Andrea De Lucia
F
Fabio Palomba
DOI:10.1007/s10664-021-10059-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
These days, over three billion users rely on mobile applications (a.k.a. apps) on a daily basis to access high-speed connectivity and all kinds of services it enables, from social to emergency needs. Having high-quality apps is therefore a vital requirement for developers to keep staying on the market and acquire new users. For this reason, the research community has been devising automated strategies to better test these applications. Despite the effort spent so far, most developers write their test cases manually without the adoption of any tool. Nevertheless, we still observe a lack of knowledge on the quality of these manually written tests: an enhanced understanding of this aspect may provide evidence-based findings on the current status of testing in the wild and point out future research directions to better support the daily activities of mobile developers. We perform a large-scale empirical study targeting 1,693 open-source Android apps and aiming at assessing (1) the extent to which these apps are actually tested, (2) how well-designed are the available tests, (3) what is their effectiveness, and (4) how well manual tests can reduce the risk of having defects in production code. In addition, we conduct a focus group with 5 Android testing experts to discuss the findings achieved and gather insights into the next research avenues to undertake. The key results of our study show Android apps are poorly tested and the available tests have low (i) design quality, (ii) effectiveness, and (iii) ability to find defects in production code. Among the various suggestions, testing experts report the need for improved mechanisms to locate potential defects and deal with the complexity of creating tests that effectively exercise the production code.
Keywords:
Software testing
Mobile applications
Empirical studies

Journal

Empirical Software Engineering cover
Empirical Software Engineering
IF:
3.6
Papers:
2.0K
Citations:
5.3K

Organization

U
University of Salerno
Scholars:
1.2W
Papers: 1.1W
Citations: 1.2W
T
tilburg university
Scholars:
4.8K
Papers: 5.7K
Citations: 4
Cited Papers

Cited Papers

On the diffuseness and the impact on maintainability of code smells: a large scale empirical investigation
err2017-08-07
err193
errOAAI
errPalomba, Fabio; Bavota, Gabriele; Di Penta, Massimiliano; Fasano, Fausto; Oliveto, Rocco; De Lucia, Andrea
errShare
errSave
errShare
errSave
Preparation of ZnGa2S4 by reacting GaI3 and ZnI2 with sulfur
err2016-06-28
err0
PREAI
errA. P. Velmuzhov; M. V. Sukhanov; A. I. Suchkov; M. F. Churbanov; E. A. Tyurina
errShare
errSave
Titania Nanobelts as a Scattering Layer with Cu2ZnSnS4 as a Counter Electrode for DSSC with Improved Efficiency
err2018-01-01
err0
PREAI
errSiva Sankar Nemala; Krishnaiah Mokurala; Parag Bhargava; Sudhanshu Mallick
errShare
errSave
Mouthwashes for the control of supragingival biofilm and gingivitis in orthodontic patients: evidence-based recommendations for clinicians
err2014-07-11
err0
errOAAI
errAlex Nogueira HAAS; Claudio Mendes PANNUTI; Ana Karina Pinto de ANDRADE; Elaine Cristina ESCOBAR; Eliete Rodrigues de ALMEIDA; Fernando Oliveira COSTA; José Roberto CORTELLI; Sheila Cavalca CORTELLI; Sigmar de Mello RODE; Vinicius PEDRAZZI; Rui Vicente OPPERMANN
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Experimental Lung Xenografting
err1997-01-01
err0
PREAI
errR. N. Pierson; G. Pino-Chavez
errShare
errSave
A survey on software coupling relations and tools
err2019-03-01
err20
errOAAI
errFregnan, Enrico; Baum, Tobias; Palomba, Fabio; Bacchelli, Alberto
errShare
errSave
Developer Testing in the IDE: Patterns, Beliefs, and Behavior
err2019-03-01
err63
errOAAI
errBeller, Moritz; Gousios, Georgios; Panichella, Annibale; Proksch, Sebastian; Amann, Sven; Zaidman, Andy
errShare
errSave
researcher View more