arrow
返回

Single-Layer Trainable Neural Network for Secure Inference

delete2025-02-01
delete0
PRE
AI
Q
Qizheng Wang
L
Lianhai Wang *
S
Shujiang Xu
S
Shuhui Zhang
邵
邵慰 (Wei Shao)
DOI:10.1109/JIOT.2024.3480195delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Secure neural network inference provides privacy guarantees for both the client and the server, and is an integral approach in Machine Learning as a Service Setting (MLaaS). However, the multilayer structure in the neural network introduces frequent activation function calculations, which causes large overhead. Most of the prior secure inference systems focused on designing cryptographic protocols to improve computational efficiency, but high computing and communication overhead are still bottlenecks in practicality. In this work, we refocus on the potential of shallow neural networks and propose a model with only one trainable layer to reduce the required computation. Our main contributions are in three-fold: 1) introduce training-free weights and formally prove their contribution in the model expressivity; 2) design the Self Enhanced Module that is more suitable for shallow models as an alternative for the activation function; and 3) propose a linear layer with multiscale and normalization property, named Nested & Norm Conv. We conduct extensive experiments on visual datasets and the results demonstrate the proposed single-layer trainable model holds promise as a viable platform for secure inference in practical applications.
Keyword:
Neural networks
Protocols
Computational modeling
Kernel
Cryptography
Data models
Circuits
Servers
Accuracy
Supercomputers
Activation component
convolution layer
neural networks
secure inference

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

Q
Qilu University of Technology
学者数:
1.1W
论文数: 8.9K
被引数: 16
引用论文

引用论文

Evolution of sociality in spiders leads to depleted genomic diversity at both population and species levels
err2017-06-27
err0
errOAAI
errV. Settepani; M. F. Schou; M. Greve; L. Grinsted; J. Bechsgaard; T. Bilde
err分享
err收藏
Redirecting the pioneering function of FOXA1 with covalent small molecules
err
IF0
err2024-03-21
err0
errOAAI
errSang Joon Won; Yuxiang Zhang; Christopher J. Reinhardt; Nicole S. MacRae; Kristen E. DeMeester; Evert Njomen; Lauren M. Hargis; Jarrett R. Remsberg; Bruno Melillo; Benjamin F. Cravatt; Michael A. Erb
err分享
err收藏
err分享
err收藏
Low-Latency Privacy-Preserving Outsourcing of Deep Neural Network Inference
err2021-03-01
err14
PREAI
errTian, Yifan; Njilla, Laurent; Yuan, Jiawei; Yu, Shucheng
err分享
err收藏
A MODEL FOR IDENTIFYING GENTRIFIED AREAS WITH CENSUS DATA
err2013-05-15
err0
PREAI
errDaniel J. Hammel; Elvin K. Wyly
err分享
err收藏
Biological Effects of Proton Radiation: What We Know and Don't Know
err2013-03-01
err0
PREAI
errSwati Girdhani; Rainer Sachs; Lynn Hlatky
err分享
err收藏
学者 查看更多内容