arrow
Return

Programmable reality

delete2025-09-27
delete0
delete
OA
AI
R
Ryo Suzuki
P
Parastoo Abtahi
C
Chen Zhu-Tian
M
Mustafa Doga Dogan
A
Andrea Colaço
E
Eric J. Gonzalez
K
Karan Ahuja
M
Mar González-Franco *
DOI:10.3389/frvir.2025.1649785delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Innovations in spatial computing and artificial intelligence (AI) are making it possible to overlay dynamic; interactive digital elements on the physical world. Soon; every object might have a real-time digital twin; enabling the “Internet of Things” so as to identify and interact with even unconnected items. This programmable reality would enable computational manipulation of the world around us through alteration of its appearance or functionality; similar to software; but for reality itself. Advances in AI language models have enabled zero-shot segmentation and understanding of the world; making it possible to query and manipulate objects with precision. However; this vision also demands natural and intuitive ways for humans to interact with these models through gestures; gaze; and existing devices. Augmented reality (AR) provides the ideal bridge between AI output and human input in the physical world. Moreover; diffusion models and physics simulations offer exciting possibilities for content generation and editing; allowing us to transform everyday activities into extraordinary experiences. As AR devices become ubiquitous and indistinguishable from reality; these technologies blur the lines between reality and simulations. This raises profound questions about how we perceive and experience the world while having implications for memory; learning; and even behavior. Programmable reality enabled by AR and AI has vast potential to reshape our relationships with the digital realm; ultimately making it an extension of the physical realm.

Journal

F
Frontiers in Virtual Reality
IF:
3.6
Papers:
1.0K
Citations:
2.4K

Organization

G
google xr
Scholars:
1
Papers: 1
Citations: 0
U
university of colorado
Scholars:
2.8K
Papers: 1.4K
Citations: 0
P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
U
University of Minnesota
Scholars:
3.4K
Papers: 1.6K
Citations: 8.5W
G
Google
Scholars:
251
Papers: 99
Citations: 4
researcher View more organizations
Cited Papers

Cited Papers

Global earthquake detection and warning using Android phones
errScience
IF45.8
err2025-07-17
err0
PREAI
errRichard M. Allen; Alexei Barski; Micah Berman; Robert Bosch; Youngmin Cho; Xia Summer Jiang; Yun-Ling Lee; Steve Malkos; S. Mostafa Mousavi; Patrick Robertson; Boone Spooner; Marc Stogaitis; Nivetha Thiruverahan; Greg Wimpey
errShare
errSave
errShare
errSave
AI-generated characters for supporting personalized learning and well-being
err2021-12-15
err99
errOAAI
errPataranutaporn, Pat; Danry, Valdemar; Leong, Joanne; Punpongsanon, Parinya; Novy, Dan; Maes, Pattie; Sra, Misha
errShare
errSave
Lumiere: A Space-Time Diffusion Model for Video Generation
err2024-12-03
err0
errOAAI
errOmer Bar-Tal; Hila Chefer; Omer Tov; Charles Herrmann; Roni Paiss; Shiran Zada; Ariel Ephrat; Junhwa Hur; Guanghui Liu; Amit Raj; Yuanzhen Li; Michael Rubinstein; Tomer Michaeli; Oliver Wang; Deqing Sun; Tali Dekel; Inbar Mosseri
errShare
errSave
A mechatronic shape display based on auxetic materials
err2021-08-06
err27
errOAAI
errSteed, Anthony; Ofek, Eyal; Sinclair, Mike; Gonzalez-Franco, Mar
errShare
errSave
Partially Blended Realities: Aligning Dissimilar Spaces for Distributed Mixed Reality Meetings
err2023-04-19
err0
errOAAI
errJens Emil Sloth Grønbæk; Ken Pfeuffer; Eduardo Velloso; Morten Astrup; Melanie Isabel Sønderkær Pedersen; Martin Kjær; Germán Leiva; Hans Gellersen
errShare
errSave
Towards Understanding Diminished Reality
err2022-04-29
err0
PREAI
errYi Fei Cheng; Hang Yin; Yukang Yan; Jan Gugenheimer; David Lindlbauer
errShare
errSave
Guidelines for Productivity in Virtual Reality
err2024-05-01
err0
errOAAI
errMar Gonzalez-Franco; Andrea Colaco
errShare
errSave
researcher View more