Publications -> Conference Papers

Autonomous Agents in Snake Game via Deep Reinforcement Learning


Authors: Z. Wei, D. Wang, M. Zhang, A.-H. Tan, C. Miao, and Y. Zhou
Title: Autonomous Agents in Snake Game via Deep Reinforcement Learning
Abstract: Since DeepMind pioneered a deep reinforcement learning (DRL) model to play the Atari games, DRL has become a commonly adopted method to enable the agents to learn complex control policies in various video games. However, similar approaches may still need to be improved when applied to more challenging scenarios, where reward signals are sparse and delayed. In this paper, we develop a refined DRL model to enable our autonomous agent to play the classical Snake Game, whose constraint gets stricter as the game progresses. Specifically, we employ a convolutional neural network (CNN) trained with a variant of Q-learning. Moreover, we propose a carefully designed reward mechanism to properly train the network, adopt a training gap strategy to temporarily bypass training after the location of the target changes, and introduce a dual experience replay method to categorize different experiences for better training efficacy. The experimental results show that our agent outperforms the baseline model and surpasses human-level performance in terms of playing the Snake Game.
Keywords: Deep reinforcement learning; Snake Game; Autonomous agent; Experience replay
Conference Name: 3rd IEEE International Conference on Agents (ICA’18)
Location: Singapore, Singapore
Publisher: IEEE
Year: 2018
Accepted PDF File: Autonomous_Agents_in_Snake_Game_via_Deep_Reinforcement_Learning_accepted.pdf
Permanent Link: https://doi.org/10.1109/AGENTS.2018.8460004
Reference: Z. Wei, D. Wang, M. Zhang, A.-H. Tan, C. Miao, and Y. Zhou, “Autonomous agents in snake game via deep reinforcement learning,” in Proceedings of the 3rd IEEE International Conference on Agents (ICA’18). IEEE, July 2018, pp. 20–25.
bibtex: 
@inproceedings{LILY-c158, 
   author = {Wei, Zhepei and Wang, Di and Zhang, Ming and Tan, Ah-Hwee and Miao, Chunyan and Zhou, You},
   title  = {Autonomous Agents in Snake Game via Deep Reinforcement Learning},  
   booktitle = {Proceedings of the 3rd IEEE International Conference on Agents (ICA'18)}, 
   year  = {2018}, 
   month = {July}, 
   pages = {20-25}, 
   location = {Singapore, Singapore},
   publisher = {IEEE},
}