arrow
Return

Learning layout generation for virtual worlds

delete2024-06-01
delete0
delete
OA
AI
W
Weihao Cheng *
Y
Ying Shan
DOI:10.1007/s41095-023-0365-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The emergence of the metaverse has led to the rapidly increasing demand for the generation of extensive 3D worlds. We consider that an engaging world is built upon a rational layout of multiple land-use areas (e.g., forest, meadow, and farmland). To this end, we propose a generative model of land-use distribution that learns from geographic data. The model is based on a transformer architecture that generates a 2D map of the land-use layout, which can be conditioned on spatial and semantic controls, depending on whether either one or both are provided. This model enables diverse layout generation with user control and layout expansion by extending borders with partial inputs. To generate high-quality and satisfactory layouts, we devise a geometric objective function that supervises the model to perceive layout shapes and regularize generations using geometric priors. Additionally, we devise a planning objective function that supervises the model to perceive progressive composition demands and suppress generations deviating from controls. To evaluate the spatial distribution of the generations, we train an autoencoder to embed land-use layouts into vectors to enable comparison between the real and generated data using the Wasserstein metric, which is inspired by the Fr & eacute;chet inception distance.
Keywords:
layout generation
virtual worlds
Transformer
land-use

Journal

Computational Visual Media cover
Computational Visual Media
IF:
18.3
Papers:
319
Citations:
2.6K

Organization

No organization information available
Cited Papers

Cited Papers

Spatiotemporal shifts in thermal climate in responses to urban cover changes: a-case analysis of major cities in Punjab, Pakistan
err2021-03-09
err0
errOAAI
errAdil Dilawar; Baozhang Chen; Yongyut Trisurat; Venus Tuankrua; Arfan Arshad; Yawar Hussain; Simon Measho; Lifeng Guo; Alphonse Kayiranga; Huifang Zhang; Fei Wang; Shaobo Sun
errShare
errSave
errShare
errSave
Language-Driven Synthesis of 3D Scenes from Scene Databases
err2018-12-04
err54
errOAAI
errMa, Rui; Patil, Akshay Gadi; Fisher, Matthew; Li, Manyi; Pirk, Soren; Binh-Son Hua; Yeung, Sai-Kit; Tong, Xin; Guibas, Leonidas; Zhang, Hao
errShare
errSave
researcher View more