arrow
Return

RenderGAN: Enhancing Real-time Rendering Efficiency with Deep Learning

delete2025-01-17
delete0
PRE
AI
M
Marco Mameli
M
Marina Paolanti
A
Adriano Mancini
P
Primo Zingaretti
R
Roberto Pierdicca
DOI:10.1145/3712263delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the domain of computer graphics, achieving high visual quality in real-time rendering remains a formidable challenge due to the inherent time-quality tradeoff. Conventional real-time rendering engines sacrifice visual fidelity for interactive performance, while image generation using path-tracing techniques can be exceedingly time-consuming. In this article, we introduce RenderGAN, a deep learning-based solution designed to address this critical challenge in real-time rendering. RenderGAN uses G-Buffers and information from a real-time rendering engine as inputs to produce output images with exceptional visual fidelity. Its encoder-decoder architecture, trained using the Generative Adversarial Network (GAN) framework with perceptual loss, enhances image realism. To evaluate RenderGAN's effectiveness, we quantitatively compare the generated images with those of a path-tracing engine, obtaining a remarkable Universal Image Quality Index (UIQI) value of 0.898. RenderGAN's open source nature fosters collaboration, driving advancements in real-time computer graphics and rendering techniques. By bridging the gap between real-time and path-tracing rendering, RenderGAN opens new horizons for accelerated image generation, inspiring innovation and unlocking the full potential of real-time visual experiences. Project page: https://github.com/marcomameli1992/RenderNet
Keywords:
Computer Graphics
Deep Learning
Generative Adversarial Networks
RenderGAN

Journal

ACM Transactions on Multimedia Computing Communications and Applications cover
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
Papers:
2.0K
Citations:
5.4K

Organization

U
Univ Macerata
Scholars:
28
Papers: 16
Citations: 2
U
Univ Politecn Marche
Scholars:
371
Papers: 156
Citations: 38
Cited Papers

Cited Papers

Image neural style transfer: A review*
err2023-05-01
err19
PREAI
errCai, Qiang; Ma, Mengxu; Wang, Chen; Li, Haisheng
errShare
errSave
Delving Deeper into Anti-Aliasing in ConvNets
err2022-10-02
err23
PREAI
errZou, Xueyan; Xiao, Fanyi; Yu, Zhiding; Li, Yuheng; Lee, Yong Jae
errShare
errSave
A universal image quality index
err2002-03-01
err4.6K
PREAI
errWang, Z; Bovik, AC
errShare
errSave
Towards Foveated Rendering for Gaze-Tracked Virtual Reality
err2016-12-05
err339
PREAI
errPatney, Anjul; Salvi, Marco; Kim, Joohwan; Kaplanyan, Anton; Wyman, Chris; Benty, Nir; Luebke, David; Lefohn, Aaron
errShare
errSave
N-Doped Graphene-Supported PtRu Direct Methanol Fuel Cell Electrocatalysts
err2013-10-27
err0
errOAAI
errSvitlana Pylypenko; Kevin Nathaniel Wood; Alexey Serov; Plamen Atanassov; Ryan O'Hayre
errShare
errSave
Heat island intensities over Brihan Mumbai on a cold winter and hot summer night
err2001-10-01
err0
errOAAI
errSHRAVAN KUMAR; THAKUR PRASAD; N. V. SASHIDHARAN; SUSHMA K. NAIR
errShare
errSave
The use of facial motion and facial form during the processing of identity
err2003-08-01
err0
PREAI
errBarbara Knappmeyer; Ian M Thornton; Heinrich H Bülthoff
errShare
errSave
researcher View more