Collaborative Research: Uncountable Markov Decision Processes and their Applications to Optimization of Large-Scale Stochastic Systems
Collaborative Research: Uncountable Markov Decision Processes and their Applications to Optimization of Large-Scale Stochastic Systems
批准号:
0900460
负责人:
Mark Lewis
金额:
$16.98万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2009
资助国家:
美国
项目状态:
已结题
起止时间:
2009-07-01 至 2013-09-30
中文摘要
该奖项是根据2009年《美国复苏和再投资法案》(公法111-5)提供资金的。该项目为具有一般状态和动作集的马尔可夫决策过程的分析和优化开发了新的方法。在连续时间马尔可夫决策过程的情况下,本课题还研究了转移速率无界的问题。马尔可夫决策过程是一种基本的随机优化模型,广泛应用于生产和服务系统的控制和管理。本项目将开发的方法将填补文献中留下的重要空白,这些空白对应用程序越来越重要。这些差距就是如何控制具有大状态空间的自然和人造系统,以及系统状态快速变化的可能性。这个项目主要有三个方面的任务。任务1将介绍具有一般状态空间、弱连续转移概率和一般动作集的马尔可夫决策过程。这项任务将发展新的理论概念和方法。此外,由于弱连续转移概率涵盖了大多数库存控制和收入管理问题,这为学者和实践者提供了解决此类问题的通用工具。任务2将研究具有无界过渡率的连续时间问题。即使在状态空间是离散的情况下,这个一般问题也已经打开了相当长的一段时间。然而,在并行处理和分布式计算领域,动作集上没有先验界限的情况变得越来越常见。我们的工作将解决这些问题。第三项任务致力于将我们前两项任务的结果应用到几个领域。我们将研究随机库存控制和收入管理问题。如果成功,该项目将为广泛类别的随机系统开发优化方法,并为解决大规模库存和收入管理问题提供理论和计算基础。
英文摘要
This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5). This project develops new methods for analysis and optimization of Markov Decision Processes with general state and action sets. In the case of continuous time Markov Decision Processes, this project also studies problems with unbounded transition rates. A Markov Decision Processes is a fundamental stochastic optimization model broadly used in various applications including control and management of production and service systems. The methods to be developed in this project stand to fill important gaps left in the literature that are becoming increasingly more crucial to applications. These gaps are how to control natural and man-made systems with large state spaces and with the possibility of rapid changes of the system states. This project focuses on three tasks. Task 1 will cover Markov Decision Processes with general state spaces, weakly continuous transition probabilities, and general action sets. This task will develop new theoretical concepts and methods. Moreover, since weakly continuous transition probabilities covers most inventory control and revenue management problems, this provides academics and practitioners with a general tool to solve such problems. Task 2 will study continuous time problems with unbounded transition rates. Even in the case when the state space is discrete, this general problem has been open for quite some time. However, in the areas of parallel processing and distributed computing it is becoming increasingly more common to not have an a priori bound on the action set. Our work will address these issues. The third task is dedicated to applying our results from the first two tasks to several areas. We shall investigate stochastic inventory control and revenue management problems. If successful, this project will develop optimization methods for broad classes of stochastic systems and provide theoretical and computation foundations for solutions of large-scale inventory and revenue management problems.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
A platform to investigate multi-tissue crosstalk mediated by exercise induced soluble factors released from human skeletal muscle
-
批准号:NC/X001970/1
-
项目类别:Research Grant
-
资助金额:$25.63万
-
财政年份:2023
-
负责人:Mark Lewis
-
依托单位:
An engineered model of stem cell engraftment for skeletal muscle regeneration
-
批准号:NE/V010069/1
-
项目类别:Research Grant
-
资助金额:$1.33万
-
财政年份:2020
-
负责人:Mark Lewis
-
依托单位:
Science and Technology Policy Inst. Basic Contract
-
批准号:1461667
-
项目类别:Contract-BOA/Task Order
-
资助金额:$3.0万
-
财政年份:2014
-
负责人:Mark Lewis
-
依托单位:
Science and Technology Policy Inst. Basic Contract
-
批准号:1455508
-
项目类别:Contract-BOA/Task Order
-
资助金额:$30.0万
-
财政年份:2014
-
负责人:Mark Lewis
-
依托单位:
Arctic Observing Assessment
-
批准号:1462273
-
项目类别:Contract-BOA/Task Order
-
资助金额:$30.0万
-
财政年份:2014
-
负责人:Mark Lewis
-
依托单位:
Science and Technology Policy Inst. Basic Contract
-
批准号:1459935
-
项目类别:Contract-BOA/Task Order
-
资助金额:$0.5万
-
财政年份:2014
-
负责人:Mark Lewis
-
依托单位:
Science and Technology Policy Inst. Basic Contract
-
批准号:1459934
-
项目类别:Contract-BOA/Task Order
-
资助金额:$1.0万
-
财政年份:2014
-
负责人:Mark Lewis
-
依托单位:
Analysis and Recommendations for Leveraging and Advancing Technology-Enhanced Education
-
批准号:1347237
-
项目类别:Contract-BOA/Task Order
-
资助金额:$8.85万
-
财政年份:2013
-
负责人:Mark Lewis
-
依托单位:
Data Collection Instrument to Evaluate the Scientific Impact of Logistical Support Provided by the United States Antarctic Program
-
批准号:1341981
-
项目类别:Contract-BOA/Task Order
-
资助金额:$15.0万
-
财政年份:2013
-
负责人:Mark Lewis
-
依托单位:
Content Analysis of National Science Board Records
-
批准号:1361247
-
项目类别:Contract-BOA/Task Order
-
资助金额:$17.5万
-
财政年份:2013
-
负责人:Mark Lewis
-
依托单位:
CUES: Cornell University Engineering Success Program
-
批准号:1317501
-
项目类别:Standard Grant
-
资助金额:$90.81万
-
财政年份:2013
-
负责人:Mark Lewis
-
依托单位:
CBET Portfolio Evaluation
-
批准号:1356036
-
项目类别:Contract-BOA/Task Order
-
资助金额:$12.41万
-
财政年份:2013
-
负责人:Mark Lewis
-
依托单位:
Alternative Jet Fuel Stakeholder Workshop
-
批准号:1359670
-
项目类别:Contract-BOA/Task Order
-
资助金额:$4.9万
-
财政年份:2013
-
负责人:Mark Lewis
-
依托单位:
Analysis of Admin. Burdens Directly Associated with the Conduct of Federally Sponsored Research and Identification of Related Opportunities for Improving Science and Engr.Outcomes
-
批准号:1265484
-
项目类别:Contract-BOA/Task Order
-
资助金额:$22.5万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
Assessment of the Viability and Feasibility of Tracking Student Participants in the NSF Research Expeirences ofr Undergraduates (REU) Sites Program
-
批准号:1232149
-
项目类别:Contract-BOA/Task Order
-
资助金额:$40.0万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
Retrospective Assessment of NSF's Support for Solid Freeform Fabrication
-
批准号:1250600
-
项目类别:Contract-BOA/Task Order
-
资助金额:$25.0万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
Program Evaluation Feasibility Study for Two OneNSF Investments: Secure Trustworthy Cyberspace, and Cyber-enabled Materials, Manufacturing and Smart Systems
-
批准号:1258430
-
项目类别:Contract-BOA/Task Order
-
资助金额:$45.0万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
A Conceptual Framework for Conducting Themed Evaluations, A Phase 1 Study
-
批准号:1252532
-
项目类别:Contract-BOA/Task Order
-
资助金额:$50.0万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
CRANNME - The complete removal of animal use for neuromuscular effectors testing
-
批准号:NC/K00087X/1
-
项目类别:Research Grant
-
资助金额:$9.4万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
Engineering fully functional, integrated skeletal muscle
-
批准号:G0900762/2
-
项目类别:Research Grant
-
资助金额:$20.6万
-
财政年份:2012
-
负责人:Mark Lewis
-
依托单位:
国内基金
海外基金
登录
查看更多内容
Research on Quantum Field Theory without a Lagrangian Description
-
批准号:24ZR1403900
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:SATOSHI NAWATA
-
依托单位:
Cell Research
-
批准号:31224802
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2012
-
负责人:程磊
-
依托单位:
Cell Research
-
批准号:31024804
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2010
-
负责人:程磊
-
依托单位:
Cell Research (细胞研究)
-
批准号:30824808
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2008
-
负责人:张爱兰
-
依托单位:
Research on the Rapid Growth Mechanism of KDP Crystal
-
批准号:10774081
-
项目类别:面上项目
-
资助金额:45.0万元
-
批准年份:2007
-
负责人:滕冰
-
依托单位: