arrow
Return

Dialogs with GenAI NPCs: Exploring Player Interactions with Speech Agents in a VR Game

delete2026-02-02
delete0
delete
OA
AI
N
Nima Zargham *
L
Leandro Tonini
D
Dmitry Alexandrovsky
E
Emma Grace Ruthven
M
Maximilian A. Friehs *
L
Leon Tristan Dratzidis
B
Bastian Dänekas
I
Ioannis Bikas
L
Lennart E. Nacke
S
Sven Zebel
R
Rainer Malaka *
DOI:10.1080/10447318.2026.2620647delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Generative artificial intelligence (GenAI) can potentially enhance player experiences by enabling more dynamic and adaptive interactions. This exploratory research investigates player perceptions and interactions with GenAI-based non-player characters (NPCs) in a speech-based Virtual Reality (VR) game. “Office Whispers,” is a VR adventure-puzzle game featuring four GenAI-based NPCs with diverse human characteristics. Our findings from the user-study show that players had an overall positive experience and found the game novel. Players appreciated the freedom of expression and felt deeply immersed when NPCs responded in a believable manner. However, issues such as unnatural conversational flow, incorrect or inconsistent responses, and uninformative dialogue disrupted immersion and gameplay. Our study contributes new insights into the potential and the current limitations of GenAI-based NPCs in speech-based games. We outline design implications and offer guidance for game designers and developers on adapting AI-based NPCs to support more immersive and engaging player experiences.
Keywords:
Generative AI
voice interaction
virtual reality
NPCs
video games

Journal

I
International Journal of Human-Computer Interaction
IF:
4.9
Papers:
4.3K
Citations:
1.2W

Organization

K
karlsruhe institute of technology
Scholars:
1.9W
Papers: 1.4W
Citations: 23
U
university of bremen
Scholars:
988
Papers: 510
Citations: 0
U
university of twente
Scholars:
1.5W
Papers: 1.4W
Citations: 9
U
university of strathclyde
Scholars:
1.1W
Papers: 1.1W
Citations: 12
U
University of Bremen
Scholars:
8.1K
Papers: 7.2K
Citations: 1.1W
U
university of waterloo
Scholars:
2.1K
Papers: 1.1K
Citations: 1
researcher View more organizations