arrow
Return

Using transformers to learn system models

delete2026-02-02
delete0
delete
OA
AI
A
Alfredo Ibias
M
Manuel Méndez
M
Manuel Núñez
F
Francisco Palomo‐Lozano *
DOI:10.1007/s10489-025-07066-0delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Models play a critical role in supporting Verification and Validation activities. However, they are often unavailable in practice, such as for legacy systems or third-party components. Model learning addresses this gap through two main approaches: passive learning, which infers models from existing execution traces, and active learning, which interacts with the system under learning (SUL) to generate more general models, but at higher computational cost. In this work, we propose a novel application of Transformer architectures to implicitly learn generic system models from execution traces alone, combining the efficiency of passive learning with the generality of active learning. We design and evaluate two Transformer-based architectures: one focused on exploitation, achieving over $$\varvec{95\%}$$ valid trace generation; and another focused on exploration, generating approximately $$\varvec{60\%}$$ novel, previously unseen traces. Our methods outperform state-of-the-art model learning techniques, demonstrating that Transformers can achieve results comparable to active learning while requiring significantly fewer resources.
Keywords:
System modelling
Transformer architecture
Model learning
Software testing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.5K
Citations:
1.7W

Organization

E
escuela superior de ingenieria
Scholars:
2
Papers: 2
Citations: 0
C
Complutense University of Madrid
Scholars:
2.6W
Papers: 2.2W
Citations: 31