Multi-routes algorithm using temperature control of Boltzmann distribution in Q value-based dynamic programming
Multi-routes algorithm using temperature control of Boltzmann distribution in Q value-based dynamic programming
复制标题
基于Q值的动态规划中利用玻尔兹曼分布温度控制的多路径算法
DOI：
10.1109/icsmc.2009.5346632
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
K. Hirasawa
中科院分区：
文献类型：
--
作者：
Shanqing Yu;S. Mabu;M. K. Mainali;S. Eto;K. Shimada;K. Hirasawa
本文提出了一种试图从全局角度提高交通系统效率的启发式方法，该方法通过基于扩展Q值的动态规划来计算每个起点-目的地(OD)对的最优行驶时间，并通过调整Boltzmann分布中的温度参数来产生全局最优路径。关键是每个路段的温度参数并不相同，而是随着路段的流量而不断变化，这使得根据最新的流量进行多样化的路由策略成为可能。仿真结果表明，与贪婪策略和恒温参数策略相比，本文提出的基于Q值的Boltzmann分布动态规划的温度参数控制策略，通过采用合适的温度参数控制策略，可以有效地减少交通拥堵，最大限度地减少信息更新间隔的负面影响。
In this paper, we propose a heuristic method trying to improve the efficiency of traffic systems in the global perspective, where the optimal traveling time for each Origin-Destination (OD)pair is calculated by extended Q value-based Dynamic Programming and the global optimum routes are produced by adjusting the temperature parameter in Boltzmann distribution. The key point is that the temperature parameter for each section is not identical, but constantly changing with the traffic of the section, which enables the diversified routing strategy depending on the latest traffics. In addition, the simulation results show that comparing with the Greedy strategy and constant temperature parameter strategy, the proposed method, i.e., temperature parameter control strategy of the Q value-based Dynamic Programming with Boltzmann distribution, could reduce the traffic congestion effectively and minimize the negative impact of the information update interval by adopting suitable temperature parameter control strategy.