课题基金 / 基金详情

New Computational Approaches for Markov Decision Processes

New Computational Approaches for Markov Decision Processes
马尔可夫决策过程的新计算方法
批准号:
0323220
负责人:
Michael Fu
金额:
$0.0万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2004
资助国家:
美国
项目状态:
已结题
起止时间:
2004-01-01 至 2008-03-31

项目摘要

项目成果

Michael Fu的其他基金

相似基金

相关文献

中文摘要
翻译
点击翻译按钮获取中文摘要
英文摘要
Developing practical computational solution methods for large-scale Markov Decision Processes (MDPs), also known as stochastic dynamic programming problems, remains an important and challenging research area. The complexity of many modern systems that can in principle be modeled using MDPs have resulted in models for which it is not possible to explicitly enumerate the transition probabilities, but for which sample paths can be easily generated, e.g., via a stochastic simulation model. The project research addresses two other distinct but crucial issues that arise: how best to allocate a computational budget that is used to generate sample paths, and how to produce a robust set of good policies directly (rather than indirectly via value function approximations). In particular, the main thrusts of our proposed approaches center on two distinct paradigms: effective sampling-based methodologies using multi-armed bandit models and induced correlation for value function estimation; and population-based approaches for finding improving policies, in contrast to the traditional policy iteration method, which iterates on a single policy. The latter thrust will focus on infinite horizon problems, where there is assumed an optimal stationary policy, whereas the former approaches are intended for finite horizon problems, where backwards induction dynamic programming must be employed. Algorithms will be developed and then analyzed in terms of their properties such as convergence rate and theoretical bounds on performance, followed by testing on specific application areas to investigate their practical utility. Specific problem domains include the pricing of American-style financial derivatives; capacity planning and preventive maintenance in manufacturing systems; and communication networks.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Collaborative Research: SCH: Optimal Desensitization Protocol in Support of a Kidney Paired Donation (KPD) System
CAREER: Maintaining volitional effort during electrical stimulation-assisted stroke rehabilitation
  • 批准号:
    1942402
  • 项目类别:
    Continuing Grant
  • 资助金额:
    $55.0万
  • 财政年份:
    2020
  • 负责人:
    Michael Fu
  • 依托单位:
New Approaches for Simulation-Based Optimal Decision Making
New Simulation-Based Approaches to Solving Markov Decision Processes
国内基金
海外基金
Computational Methods for Analyzing Toponome Data