arrow
Return

Automating software size measurement from python code using language models

delete2025-10-18
delete0
PRE
AI
S
Samet Tenekeci *
H
Hüseyin Ünlü
B
Bedir Arda Gül
D
Damla Keleş
M
Murat Küük
O
Onur Demirörs
DOI:10.1007/s10515-025-00571-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Software size is a key input for project planning, effort estimation, and productivity analysis. While pre-trained language models have shown promise in deriving functional size from natural-language requirements, measuring size directly from source code remains under-explored. Yet, code-based size measurement is critical in modern workflows where requirement documents are often incomplete or unavailable, especially in Agile development environments. This exploratory study investigates the use of CodeBERT, a pre-trained bimodal transformer model, for measuring software size directly from Python source code according to two measurement methods: COSMIC Function Points and MicroM. We construct two curated datasets from the Python subset of the CodeSearchNet corpus, and manually annotate each function with its corresponding size. Our experimental results show that CodeBERT can successfully measure COSMIC data movements with up to 91.4% accuracy and generalize to the functional, architectural, and algorithmic event types defined in MicroM, reaching up to 81.5% accuracy. These findings highlight the potential of code-based language models for automated functional size measurement when requirement artifacts are absent or unreliable.
Keywords:
Software size measurement
COSMIC
MicroM
Natural language processing
CodeBERT
BERT

Journal

A
Automated Software Engineering
IF:
3.1
Papers:
84
Citations:
0

Organization

I
Izmir Institute of Technology
Scholars:
1.9K
Papers: 1.7K
Citations: 1.8K
Cited Papers

Cited Papers

Software Size Measurement: Bridging Research and Practice
err2024-05-01
err2
PREAI
errHacaloglu, Tuna; Unlu, Huseyin; Yildiz, Ali; Demirors, Onur
errShare
errSave
researcher View more