arrow
返回

Automated test generation for Scratch programs

delete2023-05-13
delete5
delete
OA
AI
A
Adina Deiner
P
Patric Feldmeier
G
Gordon Fraser *
S
Sebastian Schweikl
W
Wengran Wang
DOI:10.1007/s10664-022-10255-xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The importance of programming education has led to dedicated educational programming environments, where users visually arrange block-based programming constructs that typically control graphical, interactive game-like programs. The Scratch programming environment is particularly popular, with more than 90 million registered users at the time of this writing. While the block-based nature of Scratch helps learners by preventing syntactical mistakes, there nevertheless remains a need to provide feedback and support in order to implement desired functionality. To support individual learning and classroom settings, this feedback and support should ideally be provided in an automated fashion, which requires tests to enable dynamic program analysis. In prior work we introduced Whisker, a framework that enables automated testing of Scratch programs. However, creating these automated tests for Scratch programs is challenging. In this paper, we therefore investigate how to automatically generate Whisker tests. Generating tests for Scratch raises important challenges: First, game-like programs are typically randomised, leading to flaky tests. Second, Scratch programs usually consist of animations and interactions with long delays, inhibiting the application of classical test generation approaches. Thus, the new application domain raises the question of which test generation technique is best suited to produce high coverage tests capable of detecting faulty behaviour. We investigate these questions using an extension of the Whisker test framework for automated test generation. Evaluation on common programming exercises, a random sample of 1000 Scratch user programs, and the 1000 most popular Scratch programs demonstrates that our approach enables Whisker to reliably accelerate test executions, and even though many Scratch programs are small and easy to cover, there are many unique challenges for which advanced search-based test generation using many-objective algorithms is needed in order to achieve high coverage.
Keyword:
Search-based testing
Block-based programming
Scratch

期刊

Empirical Software Engineering 封面图
Empirical Software Engineering
IF:
3.6
论文数:
2.0K
被引数:
5.3K

机构

U
University of Passau
学者数:
692
论文数: 680
被引数: 515
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

Integrating Ecology and Society to Navigate Turbulence
err2005-01-01
err0
errOAAI
errLance Gunderson; Carl Folke; Marco Janssen
err分享
err收藏
Vapoenucleation of the prostate using a high-power thulium laser: a one-year follow-up study
err2015-05-09
err0
errOAAI
errChing-Hsin Chang; Tzu-Ping Lin; Yen-Hwa Chang; William JS Huang; Alex TL Lin; Kuang-Kuo Chen
err分享
err收藏
Long-term disability after cerebral ischemic stroke following a Bothrops atrox snakebite in the Brazilian Amazon
err2024-08-01
err0
PREAI
errKarolaine Oliveira Bentes; Robson Luis Oliveira de Amorim; Fabiane Bianca Albuquerque Barbosa; Victor Carlos Pardo Ratis da Silva; Jefferson Valente; Fernando Almeida-Val; Jacqueline de Almeida Gonçalves Sachett; Wuelton Monteiro; Marco Aurélio Sartim
err分享
err收藏
err分享
err收藏
MobiGUITAR Automated Model-Based Testing of Mobile Apps
err2015-09-01
err244
PREAI
errAmalfitano, Domenico; Fasolino, Anna Rita; Tramontana, Porfirio; Ta, Bryan Dzung; Memon, Atif M.
err分享
err收藏
An in-depth study of the promises and perils of mining GitHub深入研究采矿GitHub的承诺和危险
err2015-09-05
err175
PREAI
errKalliamvakou, Eirini; Gousios, Georgios; Blincoe, Kelly; Singer, Leif; German, Daniel M.; Damian, Daniela
err分享
err收藏
An unusual case of priapism in a child: diagnosis and treatment
err2003-10-29
err0
PREAI
errJ.S. Jameson; T.R. Terry; A. Bolia; J.M.S. Johnstone
err分享
err收藏
Injuries in Naval Special Warfare Sea, Air, and Land Personnel: Epidemiology and Surgical Management
err2005-07-01
err0
PREAI
errShaun N. Peterson; Michael H. Call; Dallas E. Wood; Daniel V. Unger; Jon K. Sekiya
err分享
err收藏
学者 查看更多内容