Publications -> Journal Papers

Creating Autonomous Adaptive Agents in a Real-Time First-Person Shooter Computer Game


Authors: D. Wang and A.-H. Tan
Title: Creating Autonomous Adaptive Agents in a Real-Time First-Person Shooter Computer Game
Abstract: Games are good test-beds to evaluate AI methodologies. In recent years, there has been a vast amount of research dealing with real-time computer games other than the traditional board games or card games. This paper illustrates how we create agents by employing FALCON, a self-organizing neural network that performs reinforcement learning, to play a well-known first-person shooter computer game called Unreal Tournament. Rewards used for learning are either obtained from the game environment or estimated using the temporal difference learning scheme. In this way, the agents are able to acquire proper strategies and discover the effectiveness of different weapons without any guidance or intervention. The experimental results show that our agents learn effectively and appropriately from scratch while playing the game in real-time. Moreover, with the previously learned knowledge retained, our agent is able to adapt to a different opponent in a different map within a relatively short period of time.
Keywords: Reinforcement learning; Real-time computer game; Unreal Tournament; Adaptive Resonance Theory operations; Temporal difference learning
Journal Name: IEEE Transactions on Computational Intelligence and AI in Games, vol. 7, no. 2
Publisher: IEEE
Year: 2015
Accepted PDF File: Creating_autonomous_adaptive_agents_in_a_real-time first-person_shooter_computer_game_accepted.pdf
Permanent Link: http://dx.doi.org/10.1109/TCIAIG.2014.2336702
Reference: D. Wang and A.-H. Tan, “Creating autonomous adaptive agents in a real-time first-person shooter computer game,” IEEE Transactions on Computational Intelligence and AI in Games, vol. 7, no. 2, pp. 123–138, June 2015.
bibtex: 
@article{LILY-j17, 
   author	= {Wang, Di and Tan, Ah-Hwee}, 
   title	= {Creating Autonomous Adaptive Agents in a Real-Time First-Person Shooter Computer Game}, 
   journal	= {IEEE Transactions on Computational Intelligence and AI in Games}, 
   year		= {2015}, 
   month	= {June}, 
   volume	= {7}, 
   number	= {2}, 
   pages	= {123-138},
   publisher	= {IEEE},
}