Mathematical Sciences: Existence and Computation of Optimal Markov Controls for Adaptive Control Problems

数学科学：自适应控制问题的最优马尔可夫控制的存在性和计算

• 批准号: 9404990
• 负责人: Kurt Helmes
• 金额: $ 6万
• 依托单位: University of Kentucky Research Foundation
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1994
• 资助国家: 美国
• 起止时间: 1994-06-15 至 1997-11-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9404990&HistoricalAwards=false
• 关键词: Mathematical; Sciences; Existence; Computation; Optimal

9404990 Helmes/Stockbridge This project is supported jointly by the Applied Mathematics Program and the Statistics and Probability Program. It goal is to provide a constructive approach to the existence and identification of Markov controls for adaptive and singular control problems. The mathematical tools developed extend and provide a new approach to the solution of stochastic control problems. The focus will be on linear programming (LP) methods which arise naturally when the objective is to optimize a long-term average criterion. These LP methods will be extended to finite horizon and infinite horizon discounted criteria. A direct characterization of the stationary distributions identifies Markov controls and allows the value to be obtained as the solution of an infinite-dimensional LP rather than as a solution to the Hamilton-Jacobi-Bellman partial differential equation. The form of the constraints leads to a natural approximation procedure which allows numerical computation of nearly optimal controls. This project is supported jointly by the Applied Mathematics Program and the Statistics and Probability Program. Its goal is the development of a new, constructive approach to the solution of adaptive and singular stochastic control problems and of approximation procedures for the numerical computation of nearly optimal controls. This research is expected to have many important applications. Two such example are the task of managing a portfolio of stocks so as to optimize some financial goal, and the problem of valuing options. The theory of option pricing is well-understood when there are no transaction costs, but existing methods are no longer appropriate when costs are part of the transaction. Other examples of adaptive control applications range from robotic manipulators to flight contpol systems of high-performance aircraft. All these systems have to operate over a wide range of working conditions, leading to great variability in the system paramete rs. The complexity of these systems requires the implementation of adaptive controllers. The practical implementation of the controls further requires sophisticated numerical methods to find nearly optimal adaptive controllers.

9404990 Helmes/斯托克布里奇 该项目由应用数学计划和统计与概率计划共同支持。其目的是为自适应和奇异控制问题的马尔可夫控制的存在性和识别提供一种建设性的方法。 所开发的数学工具扩展和提供了一种新的方法来解决随机控制问题。重点将放在线性规划（LP）的方法，自然出现时，目标是优化长期平均标准。这些LP方法将被扩展到有限时域和无限时域的折扣准则。平稳分布的直接表征识别了马尔可夫控制，并允许将该值作为无限维LP的解而不是作为Hamilton-Jacobi-Bellman偏微分方程的解来获得。的形式的约束导致一个自然的近似程序，允许数值计算的近最优控制。 该项目由应用数学计划和统计与概率计划共同支持。它的目标是发展一种新的，建设性的方法来解决自适应和奇异随机控制问题和近似程序的数值计算的近最优控制。这项研究预计将有许多重要的应用。 两个这样的例子是管理股票投资组合以优化某些财务目标的任务，以及期权定价问题。当没有交易成本时，期权定价理论是很好理解的，但当成本是交易的一部分时，现有的方法不再适用。自适应控制应用的其他例子包括从机器人操纵器到高性能飞机的飞行控制系统。所有这些系统都必须在广泛的工作条件下运行，导致系统参数的变化很大。 这些系统的复杂性需要自适应控制器的实现。控制的实际实施还需要复杂的数值方法来找到接近最优的自适应控制器。