arrow
Return

Generating Deepfakes with Stable Diffusion, ControlNet, and LoRA

delete2026-01-01
delete0
PRE
AI
S
Stefano Bistarelli
F
Francesco Santini *
E
Edoardo Toma Tavassi
DOI:10.1007/978-3-032-00635-6_9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a different approach to generate deepfake videos based on Stable Diffusion, ControlNet, and Low-Rank Adaptation (LoRA). Stable Diffusion offers us greater control and fine-tuning options in the generation process. Compared to GANs, the proposed technique enables quick and easy modification of the obtained video by using a text prompt, adding or removing details, and altering the style and context of the deepfake. We describe the approach used and the generation pipeline, and then we show the application interface developed for the generation. Finally, we compare the quality of our deepfake generation framework with two other related approaches using two different tools that detect video/image manipulations.
Keywords:
Deepfake
Stable Diffusion
Detection

Journal

A
AVAILABILITY, RELIABILITY AND SECURITY, ARES 2025, PT III
IF:
0
Papers:
19
Citations:
0

Organization

U
University of Perugia
Scholars:
1.7W
Papers: 1.4W
Citations: 1.5W