arrow
Return

Generating Deepfakes with Stable Diffusion, ControlNet, and LoRA

delete2026-01-01
delete0
PRE
AI
S
Stefano Bistarelli
F
Francesco Santini *
E
Edoardo Toma Tavassi
DOI:10.1007/978-3-032-00635-6_9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a different approach to generate deepfake videos based on Stable Diffusion, ControlNet, and Low-Rank Adaptation (LoRA). Stable Diffusion offers us greater control and fine-tuning options in the generation process. Compared to GANs, the proposed technique enables quick and easy modification of the obtained video by using a text prompt, adding or removing details, and altering the style and context of the deepfake. We describe the approach used and the generation pipeline, and then we show the application interface developed for the generation. Finally, we compare the quality of our deepfake generation framework with two other related approaches using two different tools that detect video/image manipulations.
Keywords:
Deepfake
Stable Diffusion
Detection

Journal

A
AVAILABILITY, RELIABILITY AND SECURITY, ARES 2025, PT III
IF:
0
Papers:
19
Citations:
0

Organization

U
University of Perugia
Scholars:
1.8W
Papers: 1.4W
Citations: 1.5W
Cited Papers

Cited Papers

A Survey on Deepfake Video Detection
err2021-04-09
err0
errOAAI
errPeipeng Yu; Zhihua Xia; Jianwei Fei; Yujiang Lu
errShare
errSave
Deepfake Detection: A Systematic Literature Review
err2022-01-01
err101
errOAAI
errRana, Md Shohel; Nobi, Mohammad Nur; Murali, Beddhu; Sung, Andrew H.
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
errShare
errSave
researcher View more