AUTOMATED DISCOVERY OF OPTIONS IN REINFORCEMENT LEARNING
AUTOMATED DISCOVERY OF OPTIONS IN REINFORCEMENT LEARNING
复制标题
自动发现强化学习中的选项
DOI:
--
复制
发表时间:
2003
期刊:
影响因子:
--
通讯作者:
D. Studdert
中科院分区:
文献类型:
--
作者:
A. Kesselheim;T. Ferris;D. Studdert
AI planning benefits greatly from the use of temporally-extended or macroactions. Macro-actions allow for faster and more efficient planning as well as the reuse of knowledge from previous solutions. In recent years, a significant amount of research has been devoted to incorporating macro-actions in learned controllers, particularly in the context of Reinforcement Learning. One general approach is the use of options (temporally-extended actions) in Reinforcement Learning [22]. While the properties of options are well understood, it is not clear how to find new options automatically. In this thesis we propose two new algorithms for discovering options and compare them to one algorithm from the literature. We also contribute a new algorithm for learning with options which improves on the performance of two widely used learning algorithms. Extensive experiments are used to demonstrate the effectiveness of the proposed algorithms.