.png){kind=icon}
.png){kind=icon}
Return
Test case classification via few-shot learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.infsof.2023.107228.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Context: Crowdsourced testing can reduce testing costs and improve testing efficiency. However, crowdsourced testing generates massive test cases, requiring testers to select high-quality test cases for execution. Conse-quently, crowdsourced test cases require much effort to perform labeling due to the costly manual labor and domain knowledge.Objective: Existing methods usually fail to consider the crowdsourced testing scenario's inadequate and imbalanced data issues. We aim to effectively and efficiently classify many crowdsourced test cases for developers to alleviate manual efforts. Method: In this paper, we propose a test case classification approach based on few-shot learning and test case augmentation to address the limitations mentioned above. The proposed approach generates new test cases by the large pre-trained masked language model and extracts embedding representation by training word embedding models. Then a Bidirectional Long Short-Term Memory (BiLSTM)-based classifier is designed to perform test case classification by extracting the in-depth features. Besides, we also apply the attention mechanism to assign high weights to words that represent the test case category by lexicon matching. Results: To verify the effectiveness of the classification framework, we select 1659 test cases from three crowdsourced testing projects to conduct in-usability evaluation experiments. The experimental results show that the proposed approach has a higher accuracy and precision rate than existing classification methods.Conclusion: It can be concluded that (1) the proposed approach is an effective test case classification technique for crowdsourced testing; (2) the proposed approach is practical to help developers select high-quality test cases quickly and effectively.
Keywords:
Test case classification
Few-shot learning
Attention mechanism
Journal
IF:
4.3
Papers:
3.7K
Citations:
7.7K