The sampling threat when mining generalizable inter-library usage patterns

doi:10.1016/j.scico.2025.103393

Return

The sampling threat when mining generalizable inter-library usage patterns

2025-10-01

PRE

Yunior Pacheco *

Coen De Roover

Johannes Härtel

DOI：10.1016/j.scico.2025.103393

Original

Original request for help

Save

Abstract

En 中文

Tool support in software engineering often relies on relationships, regularities, patterns, or rules mined from other users' code. Examples include approaches to bug prediction, code recommendation, and code autocompletion. Mining is typically performed on samples of code rather than the entirety of available software projects. While sampling is crucial for scaling data analysis, it can affect the generalization of the mined patterns. This paper focuses on sampling software projects filtered for specific libraries and frameworks, and on mining patterns that connect different libraries. We call these inter-library patterns. We observe that limiting the sample to a specific library may hinder the generalization of inter-library patterns, posing a threat to their use or interpretation. Using a simulation and a real case study, we show this threat for different sampling methods. Our simulation shows that only when sampling for the disjunction of both libraries involved in the implication of a pattern, the implication generalizes well. Additionally, we show that real empirical data sampled using the GitHub search API does not behave as expected from our simulation. This identifies a potential threat relevant for many studies that use the GitHub search API for studying inter-library patterns.

Keywords:

Sampling

Usage patterns

Inter-library

Dataset

Data mining