Publications -> Conference Papers

DyETC: Dynamic Electronic Toll Collection for Traffic Congestion Alleviation


Authors: H. Chen, B. An, G. Sharon, J. Hanna, P. Stone, C. Miao, and Y. C. Soh
Title: DyETC: Dynamic Electronic Toll Collection for Traffic Congestion Alleviation
Abstract: To alleviate traffic congestion in urban areas, electronic toll collection (ETC) systems are deployed all over the world. Despite the merits, tolls are usually pre-determined and fixed from day to day, which fail to consider traffic dynamics and thus have limited regulation effect when traffic conditions are abnormal. In this paper, we propose a novel dynamic ETC (DyETC) scheme which adjusts tolls to traffic conditions in realtime. The DyETC problem is formulated as a Markov decision process (MDP), the solution of which is very challenging due to its 1) multi-dimensional state space, 2) multi-dimensional, continuous and bounded action space, and 3) time-dependent state and action values. Due to the complexity of the formulated MDP, existing methods cannot be applied to our problem. Therefore, we develop a novel algorithm, PG-β, which makes three improvements to traditional policy gradient method by proposing 1) time-dependent value and policy functions, 2) Beta distribution policy function and 3) state abstraction. Experimental results show that, compared with existing ETC schemes, DyETC increases traffic volume by around 8%, and reduces travel time by around 14.6% during rush hour. Considering the total traffic volume in a traffic network, this contributes to a substantial increase to social welfare.
Keywords: 
Conference Name: 32nd AAAI Conference on Artificial Intelligence (AAAI'18)
Location: New Orleans, USA
Publisher: AAAI Press
Year: 2018
Accepted PDF File: DyETC_Dynamic_Electronic_Toll_Collection_for_Traffic_Congestion_Alleviation_accepted.pdf
Permanent Link: https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16306
Reference: H. Chen, B. An, G. Sharon, J. P. Hanna, P. Stone, C. Miao, and Y. C. Soh, “DyETC: Dynamic electronic toll collection for traffic congestion alleviation,” in Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI’18). AAAI Press, February 2018, pp. 757–765.
bibtex: 
@inproceedings{LILY-c142, 
    author	= {Chen, Haipeng and An, Bo and Sharon, Guni and Hanna, Josiah P. and Stone, Peter and Miao, Chunyan and Soh, Yeng Chai},
    title	= {{DyETC}: Dynamic Electronic Toll Collection for Traffic Congestion Alleviation},  
    booktitle	= {Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI'18)}, 
    year		= {2018}, 
    month	= {February}, 
    pages	= {757-765}, 
    location	= {New Orleans, USA},
    publisher	= {AAAI Press},
 }