arrow
Return

Optimizing DOOM Game Using Reinforcement Learning

delete2026-01-01
delete0
PRE
AI
H
Harshali Bhuwad
R
Rushikesh Nikam
D
Dhruvi Londhekar *
S
S.N. Gunjal
J
Jarjish Siddibapa
A
Aman Singh
DOI:10.1007/978-3-032-05545-3_30delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This study explores the application of four advanced reinforcement learning (RL) algorithms-Proximal Policy Optimization (PPO), Deep Q-Networks (DQN), Advantage Actor-Critic (A2C), and Deep Deterministic Policy Gradient (DDPG)-to optimize agent performance in the Doom environment, a high-dimensional first-person shooter game. Each algorithm was trained to tackle tasks such as navigation, target elimination, and resource collection under varying levels of complexity. The experiments incorporated custom reward engineering, state- space design, and environment modifications to challenge agent adaptability. Performance evaluations revealed that PPO achieved superior stability and sample efficiency in continuous action scenarios, while DQN excelled in discrete state-action spaces with deterministic rewards. Recent applications have demonstrated the potential of reinforcement learning in controlling game agents to achieve victory and its role in facilitating game development processes for human developers. A2C demonstrated strong scalability and rapid convergence by using synchronous updates with both actor and critic networks. DDPG showcased proficiency in learning continuous control policies but required significant hyperparameter tuning for optimal performance. Across all experiments, PPO and A2C exhibited the most consistent performance in handling complex game mechanics. Comparative analysis of training time, computational resource usage, and convergence rates highlighted the trade-offs inherent in each approach. The findings underscore the efficacy of RL techniques in mastering dynamic, interactive environments like Doom and provide insights into their practical deployment for real-world applications such as robotics, autonomous navigation, and strategic decision-making systems.
Keywords:
Reinforcement Learning
Proximal Policy Optimization (PPO)
Deep Q-Networks (DQN)
A2C
Deep Deterministic Policy Gradient (DDPG)
Doom Game Optimization
Action Spaces
Agent Training

Journal

P
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON AI AND ROBOTICS, AIR
IF:
0
Papers:
37
Citations:
0

Organization

No organization information available
Cited Papers

Cited Papers

Intrinsic motivation systems for autonomous mental development
err2007-04-01
err687
errOAAI
errOudeyer, Pierre-Yves; Kaplan, Frederic; Hafner, Verena V.
errShare
errSave
Who Killed Albert Einstein? From Open Data to Murder Mystery Games
err2019-03-01
err0
errOAAI
errGabriella Alves Bulhoes Barros; Michael Cerny Green; Antonios Liapis; Julian Togelius
errShare
errSave
Human-level control through deep reinforcement learning
err2015-02-25
err0
PREAI
errVolodymyr Mnih; Koray Kavukcuoglu; David Silver; Andrei A. Rusu; Joel Veness; Marc G. Bellemare; Alex Graves; Martin Riedmiller; Andreas K. Fidjeland; Georg Ostrovski; Stig Petersen; Charles Beattie; Amir Sadik; Ioannis Antonoglou; Helen King; Dharshan Kumaran; Daan Wierstra; Shane Legg; Demis Hassabis
errShare
errSave
Grandmaster level in StarCraft II using multi-agent reinforcement learning
err2019-10-30
err0
PREAI
errOriol Vinyals; Igor Babuschkin; Wojciech M. Czarnecki; Michaël Mathieu; Andrew Dudzik; Junyoung Chung; David H. Choi; Richard Powell; Timo Ewalds; Petko Georgiev; Junhyuk Oh; Dan Horgan; Manuel Kroiss; Ivo Danihelka; Aja Huang; Laurent Sifre; Trevor Cai; John P. Agapiou; Max Jaderberg; Alexander S. Vezhnevets; Rémi Leblond; Tobias Pohlen; Valentin Dalibard; David Budden; Yury Sulsky; James Molloy; Tom L. Paine; Caglar Gulcehre; Ziyu Wang; Tobias Pfaff; Yuhuai Wu; Roman Ring; Dani Yogatama; Dario Wünsch; Katrina McKinney; Oliver Smith; Tom Schaul; Timothy Lillicrap; Koray Kavukcuoglu; Demis Hassabis; Chris Apps; David Silver
errShare
errSave
A Survey on Transfer Learning
err2010-10-01
err1.4W
PREAI
errPan, Sinno Jialin; Yang, Qiang
errShare
errSave
Deep learning
err2015-05-27
err0
PREAI
errYann LeCun; Yoshua Bengio; Geoffrey Hinton
errShare
errSave
Mastering Atari, Go, chess and shogi by planning with a learned model
err2020-12-23
err0
PREAI
errJulian Schrittwieser; Ioannis Antonoglou; Thomas Hubert; Karen Simonyan; Laurent Sifre; Simon Schmitt; Arthur Guez; Edward Lockhart; Demis Hassabis; Thore Graepel; Timothy Lillicrap; David Silver
errShare
errSave
no more