arrow
Return

Toward a Secure Framework for Regulating Artificial Intelligence Systems

delete2025-10-01
delete0
PRE
AI
H
Haroon Elahi
N
Nian Liu
J
Jiatong Chen
F
Fengwei Zhang
DOI:10.1109/TDSC.2025.3616288delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Regulating high-risk artificial intelligence (AI) systems is an urgent issue, yet technical infrastructure for their effective regulation remains scarce. In this paper, we address this gap by identifying key challenges in developing technical frameworks for AI systems’ regulation and proposing conceptual, methodological, and practical solutions to address these challenges. In this regard, we introduce the concept of AI’s operational qualification and propose the temporal self-replacement test, akin to certification tests for human operators, to examine the AI’s operational qualification. We propose measuring AI’s operational qualification across its operational properties critical for its regulatory fitness and introduce the operational qualification score as a pragmatic measure of AI’s regulatory fitness. In addition, we design and develop a Secure Framework for AI Regulation (SFAIR), a tool for automatic, recurrent, and secure examination of an AI’s operational qualification and attestation of its regulatory fitness, leveraging the proposed test and measure. Key strengths of SFAIR include its regulatory focus, flexibility in adapting to evolving regulatory requirements, and conformity to the secure-by-design principle. To achieve this, in addition to the aforementioned, we introduce a novel threat model for AI regulation frameworks. Considering the identified threats, we leverage randomization, masking, encryption-based schemes, and real-time monitoring to secure SFAIR operations. We also leverage AMD’s Secure Encrypted Virtualization-Encrypted State (SEV-ES) for enhanced system security. We validate the efficacy of the temporal self-replacement test and the practical utility of SFAIR by demonstrating its capability to support regulatory authorities in automated, recurrent, and secure AI qualification examination and attestation of its regulatory fitness using an open-source, high-risk AI system. Finally, we make the source code of SFAIR publicly available.
Keywords:
High-risk AI
AI regulation
AI testing
qualification testing
secure-by-design
trustworthy AI

Journal

IEEE Transactions on Dependable and Secure Computing cover
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
Papers:
2.6K
Citations:
9.6K

Organization

C
chalmers university of technology
Scholars:
1.5W
Papers: 1.6W
Citations: 10
S
Southern University of Science and Technology
Scholars:
5.2K
Papers: 2.1K
Citations: 34
Cited Papers

Cited Papers

Testing Framework for Black-box AI Models
err2021-05-01
err0
errOAAI
errAniya Aggarwal; Samiulla Shaikh; Sandeep Hans; Swastik Haldar; Rema Ananthanarayanan; Diptikalyan Saha
errShare
errSave
I.—COMPUTING MACHINERY AND INTELLIGENCE
errMind
IF0
err1950-10-01
err0
PREAI
errA. M. TURING
errShare
errSave
Amazon SageMaker Model Monitor: A System for Real-Time Insights into Deployed Machine Learning Models
err2022-08-14
err0
errOAAI
errDavid Nigenda; Zohar Karnin; Muhammad Bilal Zafar; Raghu Ramesha; Alan Tan; Michele Donini; Krishnaram Kenthapadi
errShare
errSave
A Survey on Security and Privacy Issues in Edge-Computing-Assisted Internet of Things
err2021-03-15
err202
errOAAI
errAlwarafy, Abdulmalik; Al-Thelaya, Khaled A.; Abdallah, Mohamed; Schneider, Jens; Hamdi, Mounir
errShare
errSave
MASTERKEY: Automated Jailbreaking of Large Language Model Chatbots
err2024-01-01
err0
errOAAI
errGelei Deng; Yi Liu; Yuekang Li; Kailong Wang; Ying Zhang; Zefeng Li; Haoyu Wang; Tianwei Zhang; Yang Liu
errShare
errSave
Machine Learning Testing: Survey, Landscapes and Horizons
err2022-01-01
err441
errOAAI
errZhang, Jie M.; Harman, Mark; Ma, Lei; Liu, Yang
errShare
errSave
researcher View more