arrow
Return

Watermarking for Stable Diffusion Models

delete2024-11-01
delete4
PRE
AI
L
Li Li
Z
Zichi Wang
X
Xinpeng Zhang *
DOI:10.1109/JIOT.2024.3434656delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the scenario of text data and image data interact of the Internet of Things (IoT) applications, the problem of copyright protection of the text-to-image models is threatened due to the replicability and portability of the neural network model. In order to solve this problem, we propose a model watermarking for the typical text-to-image diffusion models (DMs)-stable DMs (SDMs), which is a key aspect of the copyright protection of text-to-image models. Our scheme injects watermark into an SDM and makes the SDM generate watermark through a predefined prompt. The ownership of the SDM can be proved by the different output results of the model to the predefined prompt. The proposed method does not require raw training data and internal details of SDMs, which only need a predefined prompt and watermark to fine tune the pretrained SDM with minimal epoch. A large number of experiments show that our watermarking technology is effective, and can realize the copyright protection of the SDMs on the premise of less influence on the original function.
Keywords:
Copyright protection
deep learning
neural network watermarking
security
stable diffusion models (SDMs)
Copyright protection
deep learning
neural network watermarking
security
stable diffusion models (SDMs)

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

S
shanghai university
Scholars:
3.9W
Papers: 2.7W
Citations: 52
Cited Papers

Cited Papers

Nigericin inhibits epithelial ovarian cancer metastasis by suppressing the cell cycle and epithelial−mesenchymal transition
err2017-08-18
err0
PREAI
errWen Wang; Yan Zhao; Shujuan Yao; Xiujuan Cui; Wenying Pan; Wenqian Huang; Jiangang Gao; Taotao Dong; Shiqian Zhang
errShare
errSave
Ki-67 Proliferation Index
err2004-02-01
err0
PREAI
errMichael G. Alexandrakis; Freda H. Passam; Despina S. Kyriakou; Konstantina Dambaki; Maria Niniraki; Efstathios Stathopoulos
errShare
errSave
Die Realität der Massenmedien
err
IF0
err1996-01-01
err0
errOAAI
errNiklas Luhmann
errShare
errSave
Bitter pills for drug companies
errBMJ
IF0
err2010-09-17
err0
PREAI
errM. Newman
errShare
errSave
A Data Integrity Authentication Scheme in WSNs Based on Double Watermark
err2023-05-01
err2
PREAI
errGao, Guangyong; Han, Tingting; Feng, Zhao; Wang, Min; Xia, Zhihua
errShare
errSave
errShare
errSave
researcher View more