Research on Stochastic Processes and Optimization

随机过程与优化研究

• 批准号: 9704426
• 负责人: Paul Dupuis
• 金额: $ 12.43万
• 依托单位: Brown University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1997
• 资助国家: 美国
• 起止时间: 1997-07-01 至 2000-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9704426&HistoricalAwards=false
• 关键词: Research; Stochastic; Processes; Optimization

9704426 Dupuis This project covers three topics: (i) theory and applications of the Skorokhod Problem; (ii) large deviations and risk sensitive control and robust control of queueing networks; and (iii) computational methods for deterministic optimal control problems and related first order nonlinear PDE. The solution to the Skorokhod Problem defines what might be considered the input/output map for a number of exact and approximate models in queueing, communication, economics, and other areas. Except in special cases, little is known about the analytical properties of this mapping. This research will build on prior work of the investigator and H. Ishii which takes a geometric approach to obtaining regularity conditions for the Skorokhod Problem. The main thrust of the present work is the development and application of methods based on convex duality. The second part of the project studies large deviations for queueing networks. The main topic here is the formulation and analysis of risk sensitive criteria for the control and regulation of queueing networks. In almost all models for networks there are errors, approximations, and model uncertainty, and one would like to design control schemes that are insensitive to such errors. Using the duality between exponential integrals and the relative entropy function, one can (at least in the context of diffusions) give a precise quantitative characterization of the additional robustness properties that are obtained when a risk sensitive criteria is used. The investigator will formulate and analyze via large deviation techniques such criteria in a queueing context. The final part of the project considers cmmputational methods for deterministic optimal control problems. The main emphasis here is on the development of practical algorithms with good qualitative properties. This will be done for a class of problems with very similar features that arise in large deviation for diffusions, certain problems fr om computer vision, and robust nonlinear control and robust filtering. Modern communication, computer, and queueing systems are very complicated, and in fact too complicated to analyze in complete detail. As systems become more and more heterogeneous (e.g., different data classes, different quality of service requirements, etc.) the control and regulation of these systems becomes more difficult and less intuitive. The first two parts of this project investigate two approaches to dealing with such systems. When analyzing queueing and communication systems one needs (relatively) simple system models which capture the most important aspects of the true system. Linear systems are unable to capture the system behavior caused by hard constraints (non-negativity of queue lengths, limits on buffer sizes, etc.) and discontinuities that occur naturally in well designed routing and service protocols. Part of this research is to look at alternatives to linear systems. The second part focuses on the study of risk sensitive criteria for such systems. Risk sensitive and robust criteria provide alternatives to traditional criteria for the evaluation of system performance, and it is now understood that they are very useful in situations where model uncertainty and robustness against modeling errors are important. Such robustness properties are always important for communication and manufacturing systems. The aim here is to properly formulate and analyze risk-sensitive criteria for random networks, and to quantify the robustness properties when compared to traditional criteria. The last part of the project is devoted to the development of usable and efficient computational methods for deterministic optimal control problems, and in particular to the class of problems that arise in the second part of the proposal.

9704426 Dupuis这个项目包括三个主题：(I)Skorokhod问题的理论和应用；(Ii)排队网络的大偏差和风险敏感控制与鲁棒控制；(Iii)确定性最优控制问题和相关的一阶非线性偏微分方程的计算方法。Skorokhod问题的解决方案定义了排队、通信、经济学和其他领域中许多精确和近似模型的输入/输出映射。除了在特殊情况下，人们对这种映射的分析性质知之甚少。这项研究将建立在调查者和H.Ishii之前的工作基础上，他们采用几何方法来获得Skorokhod问题的正则性条件。本工作的主旨是发展和应用基于凸对偶的方法。项目的第二部分研究了排队网络的大偏差问题。这里的主要主题是制定和分析控制和监管排队网络的风险敏感标准。在几乎所有的网络模型中都存在误差、近似和模型不确定性，人们希望设计对这些误差不敏感的控制方案。利用指数积分和相对熵函数之间的对偶性，人们可以(至少在扩散的背景下)精确地定量描述当使用风险敏感标准时获得的附加稳健性。调查员将通过大偏差技术在排队环境中制定和分析这样的标准。项目的最后部分考虑确定性最优控制问题的计算方法。这里的主要重点是开发具有良好定性性质的实用算法。这将用于一类具有非常相似的特征的问题，这些问题出现在扩散的大偏差、计算机视觉的某些问题、以及稳健的非线性控制和稳健过滤。现代通信、计算机和排队系统非常复杂，而且实际上太复杂了，无法完全详细地分析。随着系统变得越来越异构化(例如，不同的数据类别、不同的服务质量要求等)对这些系统的控制和监管变得更加困难，变得不那么直观。本项目的前两部分研究了两种处理此类系统的方法。当分析排队和通信系统时，人们需要(相对)简单的系统模型来捕捉真实系统的最重要的方面。线性系统无法捕获由硬约束(队列长度的非负性、缓冲区大小限制等)引起的系统行为以及在设计良好的路由和服务协议中自然出现的中断。这项研究的一部分是寻找线性系统的替代方案。第二部分重点研究了这类系统的风险敏感标准。风险敏感和稳健的标准为评估系统性能的传统标准提供了替代方案，现在人们认识到，在模型不确定性和对建模错误的稳健性非常重要的情况下，这些标准非常有用。这种健壮性特性对于通信和制造系统来说总是很重要的。这里的目的是正确地制定和分析随机网络的风险敏感准则，并量化与传统准则相比的稳健性。该项目的最后部分致力于为确定性最优控制问题开发可用和有效的计算方法，特别是在提案的第二部分中出现的这类问题。