arrow
Return

Security-Augmented Use Case Flow Refinement for LLM-Based Agentic Systems

delete2026-09-13
delete0
delete
OA
AI
G
Guangyu Wang
B
Bangqi Li
J
Ji Wu *
Z
Zhijun Shao
DOI:10.3390/electronics15184135delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unlike conventional software systems and large language models (LLMs) evaluated in isolation, LLM-based agentic systems introduce a compositional, workflow-level attack surface. Existing security analysis approaches provide limited support for identifying security omissions implicit in functional use case flows and deriving corresponding flow refinements for direct incorporation into use case specifications. We formulate the Security-Augmented Use Case Flow Refinement Task and propose MA-SAFR, a multi-agent framework that coordinates Red Team, Blue Team, and Critic agents for threat anchoring, security-branch construction, and validation. EvoGraphRAG adapts relation-aware retrieval through validation feedback, while Risk-Specific Security Guidance (RSSG) provides risk- and role-specific constraints. To support systematic evaluation of this task, we construct SAFR-Bench from OWASP and MITRE ATLAS, comprising 157 cases and 235 source-grounded threat–refinement pairs. Across three generation models, MA-SAFR improves all three metrics on average compared with the strongest corresponding baselines; pipeline recall and pipeline precision increase by 63.44% and 54.96%, respectively. Controlled analyses show that RSSG and feedback-based graph evolution within gEvoGraphRAG improve downstream threat-to-defense conversion. Despite remaining challenges in implicit-threat identification, multi-threat coverage, and defense alignment, the results show that MA-SAFR can support the construction of valid security-augmented use case flows.
Keywords:
LLM-based agentic systems
security requirements engineering
use case flow refinement
multi-agent systems

Journal

Electronics cover
Electronics
IF:
2.6
Papers:
1.1W
Citations:
4.7W

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
Cited Papers

Cited Papers

AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
err2024-01-01
err0
PREAI
errDebenedetti,Edoardo; Zhang,Jie; Balunovic,Mislav; Beurer-Kellner,Luca; Fischer,Marc; Tramèr,Florian
errShare
errSave
Eliciting security requirements with misuse cases
err2004-06-24
err0
PREAI
errGuttorm Sindre; Andreas L. Opdahl
errShare
errSave
Toolformer: Language Models Can Teach Themselves to Use Tools
err2023-01-01
err0
PREAI
errCancedda,Nicola; Dessi,Roberto; Dwivedi-Yu,Jane; Hambro,Eric; Lomeli,Maria; Raileanu,Roberta; Schick,Timo; Scialom,Thomas; Zettlemoyer,Luke
errShare
errSave
MedAgentBench: A Virtual EHR Environment to Benchmark Medical LLM Agents
err2025-08-28
err0
PREAI
errJiang,Yixing; Black,Kameron C.; Geng,Gloria; Park,Danny; Zou,James; Ng,Andrew Y.; Chen,Jonathan H.
errShare
errSave
Security requirements engineering: A framework for representation and analysis
err2008-01-01
err257
PREAI
errHaley, Charles B.; Laney, Robin; Moffett, Jonathan D.; Nuseibeh, Bashar
errShare
errSave
Self-Refine: Iterative Refinement with Self-Feedback
err2023-01-01
err0
PREAI
errAlon,Uri; Clark,Peter; Dziri,Nouha; Gao,Luyu; Gupta,Prakhar; Gupta,Shashank; Hallinan,Skyler; Hermann,Katherine; Madaan,Aman; Majumder,Bodhisattwa Prasad; Prabhumoye,Shrimai; Tandon,Niket; Welleck,Sean; Wiegreffe,Sarah; Yang,Yiming; Yazdanbakhsh,Amir
errShare
errSave
Modeling Security and Privacy Requirements: a Use Case-Driven Approach
err2018-08-01
err45
errOAAI
errMai, Phu X.; Goknil, Arda; Shar, Lwin Khin; Pastore, Fabrizio; Briand, Lionel C.; Shaame, Shaban
errShare
errSave
A comparative benchmark study of LLM-based threat elicitation tools
err2025-11-15
err0
PREAI
errDimitri Van Landuyt; Majid Mollaeefar; Mario Raciti; Stef Verreydt; Abdulaziz Kalash; Andrea Bissoli; Davy Preuveneers; Giampaolo Bella; Silvio Ranise
errShare
errSave
Reusable knowledge in security requirements engineering: a systematic mapping study
err2015-02-25
err0
errOAAI
errAmina Souag; Raúl Mazo; Camille Salinesi; Isabelle Comyn-Wattiau
errShare
errSave
researcher View more