Publications -> Conference Papers

Probabilistic Guided Exploration for Reinforcement Learning in Self-Organizing Neural Networks


Authors: P. Wang, W. J. Zhou, D. Wang, and A.-H. Tan
Title: Probabilistic Guided Exploration for Reinforcement Learning in Self-Organizing Neural Networks
Abstract: Exploration is essential in reinforcement learning, which expands the search space of potential solutions to a given problem for performance evaluations. Specifically, carefully designed exploration strategy may help the agent learn faster by taking the advantage of what it has learned previously. However, many reinforcement learning mechanisms still adopt simple exploration strategies, which select actions in a pure random manner among all the feasible actions. In this paper, we propose novel mechanisms to improve the existing knowledge-based exploration strategy based on a probabilistic guided approach to select actions. We conduct extensive experiments in a Minefield navigation simulator and the results show that our proposed probabilistic guided exploration approach significantly improves the convergence rate.
Keywords: Reinforcement learning; Self-organizing neural networks; Guided exploration
Conference Name: 3rd IEEE International Conference on Agents (ICA’18)
Location: Singapore, Singapore
Publisher: IEEE
Year: 2018
Accepted PDF File: Probabilistic_Guided_Exploration_for_Reinforcement_Learning_in_Self-Organizing_Neural_Networks_accepted.pdf
Permanent Link: https://doi.org/10.1109/AGENTS.2018.8460067
Reference: P. Wang, W. J. Zhou, D. Wang, and A.-H. Tan, “Probabilistic guided exploration for reinforcement learning in self-organizing neural networks,” in Proceedings of the 3rd IEEE International Conference on Agents (ICA’18). IEEE, July 2018, pp. 109–112.
bibtex: 
@inproceedings{LILY-c161, 
   author = {Wang, Peng and Zhou, Weigui Jair and Wang, Di and Tan, Ah-Hwee},
   title  = {Probabilistic Guided Exploration for Reinforcement Learning in Self-Organizing Neural Networks},  
   booktitle = {Proceedings of the 3rd IEEE International Conference on Agents (ICA'18)}, 
   year  = {2018}, 
   month = {July}, 
   pages = {109-112}, 
   location = {Singapore, Singapore},
   publisher = {IEEE},
}