arrow
Return

GenMix: Effective data augmentation with generative diffusion model image editing

delete2026-04-07
delete0
delete
OA
AI
K
Khawar Islam *
M
Muhammad Zaigham Zaheer
A
Arif Mahmood
K
Karthik Nandakumar
N
Naveed Akhtar
DOI:10.1016/j.eswa.2026.132273delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Data augmentation is widely used to enhance generalization in visual classification tasks. However, traditional methods struggle when source and target domains differ, as in domain adaptation, due to their inability to address domain gaps. We introduce a novel GenMix, a generalizable prompt-guided generative data augmentation approach that enhances both in-domain and cross-domain image classification. Our technique leverages image editing to generate augmented images based on custom conditional prompts, designed specifically for each problem type. By blending portions of the input image with its edited generative counterpart and incorporating fractal patterns, our approach mitigates unrealistic images and label ambiguity, improving performance and adversarial robustness of the resulting models. Our GenMix further incorporates a faithfulness-aware filtration step that retains only semantically consistent edited images for augmentation. Efficacy of our method is established with extensive experiments on eight public datasets for general and fine-grained classification, in both in-domain and cross-domain settings. Additionally, we demonstrate performance improvements for self-supervised learning, learning with data scarcity, and adversarial robustness. As compared to the existing state-of-the-art methods, our technique achieves stronger performance across the board. The Code is available on https://github.com/khawar-islam/GenMix
Keywords:
Data augmentation
Diffusion models
Generative models
Synthetic data
Image editing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

I
information technology university
Scholars:
3
Papers: 4
Citations: 0
T
the university of melbourne
Scholars:
2.4K
Papers: 1.2K
Citations: 1
researcher View more organizations